JP2017138581A - Projection image adjustment system and projection image adjustment method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection image adjustment system that alleviates an operation burden when adjusting a projection image of a plurality of projection-type display devices to a desired shape or characteristic, using a plurality of imaging devices.SOLUTION: A projection image adjustment system comprises: a plurality of projectors 101 to 105; a plurality of cameras 201 and 202; and adjustment-purpose PC 300. The plurality of cameras 201 and 202 are configured to shoot a projection image to be projected by respective projectors handled by the camera. The adjustment-purpose PC 300 is configured to: select one of the plurality of cameras; set a responsible range of the projector handled by the selected camera; cause the projector having the responsible range set to project a first format pattern; and display image data shot by the selected camera.SELECTED DRAWING: Figure 16

Description

  The present disclosure relates to a display region including a plurality of projection display devices, and relates to a projection image adjustment system and method for adjusting a desired shape or characteristic using a plurality of imaging devices.

  Patent Document 1 discloses an image projection system that displays a single image by joining partial images projected by a plurality of image projection apparatuses on a single screen, and an overlap between partial images projected by a plurality of image projection apparatuses. Disclosed is an image geometric correction device that geometrically corrects each partial image so that the portions are smoothly connected. The image geometric correction device unifies the coordinate system of images taken by a plurality of image photographing devices, and geometrically projects the images projected by the plurality of image projection devices on the basis of the image projection range on the coordinate system after the unification. to correct. As a result, the projected image can be geometrically corrected without strictly placing the image capturing device at a predetermined position.

International Publication No. 2006/030501

  However, when setting the relationship between the image capturing device and the image projecting device, the user must always know which image capturing device includes the projected image of which image projecting device in the capturing range. Take it.

  The present disclosure is a system that adjusts a single image displayed using a plurality of projection display devices to a desired shape or characteristic using a plurality of imaging devices, which is designated by the selected imaging device. It is easy to check whether the projection range of the projection display device is included, and if not, operations such as position adjustment of the imaging device, change of selection, or change of the projection range of the projection display device are facilitated. A projected image adjustment system is provided.

  A projection image adjustment system of the present disclosure includes a plurality of projection display devices that project a projection image on a projection surface, a first imaging device and a second imaging device that capture a projection image displayed on the projection surface, and a plurality of projections. And a control device for controlling the first imaging device and the second imaging device. The control device includes an imaging device selection unit, an imaging range setting unit, a pattern projection unit, and a captured image display unit. The imaging device selection unit selects the first imaging device or the second imaging device. The imaging range setting unit includes the first assigned range and the second imaging of the projection display device in which the first imaging device is responsible for imaging so as to include at least one projection display device in common among the plurality of projection display devices. The second assigned range of the projection display device for which the device is in charge of shooting is set. The pattern projection unit causes the projection display device corresponding to the first charge range or the second charge to project the first format pattern based on the selection of the imaging device selection unit. The captured image display unit displays a captured image captured by the first imaging device or a captured image captured by the second imaging device based on the selection of the imaging device selection unit.

  The projection image adjustment system according to the present disclosure can easily check whether the selected imaging device includes the projection range of the designated projection display device. When not included, operations such as position adjustment of the imaging device, change of selection, or change of the projection range of the projection display device are facilitated.

Schematic diagram showing the state when the projector is connected to the network Functional block diagram of the projector Functional block diagram of the camera Functional block diagram of PC for adjustment Flow chart for explaining the operation for fitting the projected image to the screen Diagram showing test pattern for detecting camera coordinates Network connection diagram after adjusting the projection area of the projector The figure which shows the application screen which connects the projector Data structure diagram for storing projector layout information at the time of connection The figure which shows the application screen which makes arrangement setting of the projector The figure which shows the application screen (before setting) which performs the arrangement setting of the projector A diagram showing an example of projector projection when setting the projector layout The figure which shows the application screen (after setting) which performs arrangement setting of a projector The figure which shows the data structure figure (after setting) which stores the arrangement information of the projector The figure which shows the application screen which connects the camera The figure which shows the example of a projector projection at the time of camera arrangement setting The figure which shows the application screen which performs the arrangement setting of the camera The figure which shows the application screen which performs the arrangement setting of the camera The figure which shows the application screen which performs the arrangement setting of the camera The figure which shows the data structure figure which stores the arrangement information of the camera Diagram showing the application screen for adjusting camera exposure, white balance, and focus Diagram showing the application screen for setting the projection area and overlap width Figure showing a projector projection example when setting the projection area The figure which shows the application screen which displays the progress situation in the automatic execution phase

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

  The inventor provides the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and is intended to limit the subject matter described in the claims. is not.

(Embodiment)
Hereinafter, embodiments will be described with reference to FIGS.

[1-1. Network connection configuration and arrangement configuration]
FIG. 1 is a schematic diagram illustrating a state when projectors (projection display devices) 101 to 105, cameras (imaging devices) 201 to 202, and an adjustment PC (Personal Computer) 300 according to an embodiment are connected to a network. It is. The plurality of projectors 101 to 105 are disposed in front of the screen (projection plane) 400 and are projected so as to project an image onto the screen 400, via a LAN (Local area network) cable, a network hub 500, and a wireless access point 600. Connected to the adjustment PC 300. The plurality of cameras 201 and 202 are arranged in front of the screen 400 so as to photograph a predetermined area including the screen 400, and are connected to the adjustment PC 300 by wire or wirelessly. The projected image adjustment system 10 is configured by connecting projectors 101 to 105, cameras 201 to 202, and an adjustment PC 300 to a network.

  For example, as shown in FIG. 1, the projectors 101 to 105 are arranged in the horizontal direction, the area is divided, and a projection image that forms a display image to be displayed on the screen is projected. Even in such a case, an image can be displayed. In general, when projecting such an image, project the image so that a part of the projection area of adjacent projectors overlaps, and gradually crossfade the brightness of the image in the overlapped area to obscure the joints. A technique called “edge blending” is used. Further, although not shown, a technique called “stack projection” may be used in which a plurality of projectors are superimposed and projected on the same projection area to display a brighter image.

  FIG. 2 is a functional block diagram of the projector 101 used in the embodiment. Since the projectors 102 to 105 have the same configuration, only the projector 101 will be described. The projector 101 includes an image generation unit 1010 that generates an image and a projection unit 1016 that projects an image on a projection plane. The image generation unit 1010 includes a wireless communication unit 1011 having an access point function for wireless communication, a wired communication unit 1012 connected to a LAN cable to perform wired communication, a storage unit 1013, an image processing unit 1014, and a control unit 1015. It is comprised including. The storage unit 1013 stores image information such as a projection pattern to be described later, identification data indicating the SSID of the projection display device itself, and the like.

  FIG. 3 is a functional block diagram of the camera 201. Since the functional blocks of the camera 202 are the same, only the camera 201 will be described. The camera 201 includes a control unit 2010, an image processing unit 2011, a display driver 2012, a monitor 2013, an operation unit 2014 that is a key input unit, a wireless communication unit 2015 that is a wireless LAN circuit, a USB communication unit 2016 that is a USB interface circuit, and a capacitor. 2017, a battery 2018, a flash 2019, a CCD (Charge Coupled Device) driver-2020, a CCD 2021, and a memory 2022. A memory card 2023 as a recording medium is loaded in a card slot (not shown).

  The control unit 2010 is a circuit for executing various processes and controls, and is configured using a microcomputer or the like. An image processing unit 2011 is a circuit that compresses / decompresses captured image data. The display driver 2012 is a drive circuit that controls an image displayed on the monitor 2013. The operation unit 2014 is a circuit that detects operations of buttons, switches, dials, and the like provided in the camera 201.

  The wireless communication unit 2015 is a communication circuit for communicating with an external device wirelessly. The USB communication unit 2016 is a communication circuit for communicating with an external device using a USB cable. The capacitor 2017 is charged by receiving power from the battery 2018 and used for light emission of the strobe 2019. The battery 2018 is a power source such as a lithium ion rechargeable battery that supplies power necessary for operating the imaging apparatus.

  The strobe 2019 enables photographing even in a dark environment by irradiating the subject with auxiliary light. The CCD driver 2020 is a circuit for driving the CCD 2021. The CCD 2021 is an image sensor for capturing a subject image via a photographing lens. When a subject image is picked up by the CCD 2021, an image pickup signal is output from the CCD 2021 to the CCD driver 2020. The imaging signal is converted into captured image data by the CCD driver 2020 and then output to the control unit 2010.

  The memory 2022 is a nonvolatile semiconductor memory, and stores programs, data, and the like for use in control executed by the control unit. The memory card 2023 records various types of information such as captured image information acquired by the imaging device under the control of the control unit.

  FIG. 4 is a functional block diagram of the adjustment PC 300 in the embodiment. The adjustment PC 300 includes a wireless communication unit 301, a wired communication unit 302, a storage unit 303 that stores image data and the like, a UI unit 304 that is a user interface that accepts a selection instruction by a user, a control unit 305, image data, and the like. The image processing unit 306 that generates an image based on the above and the display unit 307 that displays the image are included. The hardware of the adjustment PC 300 is general. For example, the wireless communication unit 301 is a wireless LAN unit or the like, the storage unit 303 is a hard disk or RAM, the UI unit 304 is a control unit such as a keyboard or a mouse. Reference numeral 305 denotes a CPU, the display unit 307 includes a liquid crystal display, and the USB communication unit 308 includes a USB port. Here, the adjustment PC 300 is an example of a control device.

  The plurality of cameras 201 and 202 are connected to the adjustment PC 300 via the USB communication unit 2016. In response to an instruction from the adjustment PC 300, the cameras 201 and 202 capture an area partially including the screen 400 and transmit the image data to the adjustment PC 300. The cameras 201 and 202 and the adjustment PC 300 may be connected by wireless communication such as WiFi by the wireless communication unit 2015 and the wireless communication unit 301.

  The adjustment PC 300 issues commands to the projectors 101 to 105 and the cameras 201 and 202 to perform control. Further, as will be described later, the adjustment PC 300 acquires a projection state, calculates correction data, and transmits correction data by the control unit 1015 in order to match the images projected from the projectors 101 to 105 with the screen 400.

[1-2. Operation]
The operation of the projection image adjustment system 10 configured as described above will be described below.

  FIG. 5 is a flowchart showing an operation (hereinafter referred to as “projection area automatic adjustment operation”) for adjusting the projectors 101 to 105 by the adjustment PC 300 so that the projected image fits within the area of the screen 400. The projection area automatic adjustment operation is realized by the adjustment PC 300 executing a specific application program, and includes a setting phase (S100 to S500) and an automatic execution phase (S600 to S1000).

  When the projection area automatic adjustment operation is started, the adjustment PC 300 first establishes a network connection with the projectors 101 to 105 and can identify each projector with a temporary ID (for example, a number is assigned from 1 in the order of connection). (S100). Next, the number of projectors that display images on the screen 400 is specified in the horizontal direction, the vertical number, and the number of stacks, and the projector identified in step S100 projects which part of the area of the screen 400 in the actual layout. Whether the projector is the projector to be connected is linked to the relationship of the arrangement position, and the projector ID is assigned according to the positional relationship (S200).

  Next, the cameras 201 and 202 used for adjustment are connected to the adjustment PC 300, and each camera can be identified by an ID (for example, a number is assigned from 1 in the order of connection) (S300). Subsequently, for each of a plurality of connected cameras, it is designated which projection area of each projector each camera captures (S400). In particular, adjacent cameras are arranged and designated so that the projected images of at least one projector can be taken by both cameras.

  Next, an overlap width, which is the width of the area of the screen 400 on which the projectors 101 to 105 project an image, and the area of the adjacent projector to be projected is set (S500). Specifically, the area of the screen 400 is set by setting a cursor at an equal interval on the edge of the screen 400 and recording the projector ID and coordinates on which the cursor is displayed.

  When all the settings up to here are completed and execution is instructed, the process proceeds to the automatic execution phase.

  In order to obtain the relationship between the projection position of the projector and the pixel position of the camera, a test pattern having a plurality of feature points as shown in FIG. 6 is projected from each projector and photographed by the camera (S600). Based on the projection area of the projector assigned to each camera set in step S400, the test patterns projected in all combinations are photographed. The test pattern as shown in FIG. 6 can be stored in advance in the storage unit 303 of the adjustment PC 300 and transmitted to each projector for projection.

  Next, a coordinate conversion table for detecting camera coordinates of a plurality of feature points included in the test pattern from the captured image and converting the projector coordinate system to the camera coordinate system from the correspondence between the projector coordinates of the feature points and the camera coordinates. Is obtained (S700). Next, for adjacent cameras, a coordinate conversion formula between the cameras is calculated from the relationship of the respective camera coordinates corresponding to the same feature point of the projected image of the same projector taken by both cameras (S800). For example, as shown in paragraphs [0025] to [0027] of Patent Document 1, the calculation of the coordinate conversion formula between the cameras is performed by calculating the correspondence between the camera coordinates obtained from the same feature points of the projected image of the same projector. There is a method of obtaining a plane projective transformation matrix H (Homography) using four or more sets.

  Next, the adjustment PC 300 unifies the coordinate system from the values recorded as the coordinate system of each projector using the coordinate conversion table obtained in step S700 and the coordinate conversion formula between the cameras obtained in step S800. I do. Then, geometric correction data for adjusting the projection image of each projector to the projection area of the screen 400 is calculated from the position information of the projection area of the screen 400 set in step S500 and the position information of the projector (S900).

  Finally, the adjustment PC 300 transfers the calculated geometric correction data and overlap width to each projector (S1000). As a result, as shown in FIG. 7, before the adjustment, the projection image of each projector protrudes from the screen (the projection image before adjustment is indicated by a one-dot chain line), and can be fitted to the screen 400, and A smooth image of the joint can be obtained.

  The detailed operation of the setting phase (S100 to S500) in the flowchart described above will be described below.

  FIG. 8 shows an application screen 1000 in step S100 for establishing a network connection between the adjustment PC 300 and the projectors 101 to 105 and identifying each projector with a temporary ID. This application screen is a display unit 307 of the adjustment PC 300. Is displayed. When the Search Projector button 1002 is pressed, the adjustment PC 300 searches for projectors 101 to 105 existing on the network and displays them in a list 1001 on the right. Also, when the Add Projector button 1003 is pressed, an input screen (not shown) is displayed, and the input of the IP address and projector name of the projector to be added is prompted. When these are input, the adjustment PC 300 confirms the existence by communication, and if it can be confirmed, additionally displays it in the list 1001. With these processes, the list 1001 displays the projector name, IP address, and model name of the projector whose connection has been confirmed on the network.

  Next, the user checks the projector to be adjusted from the list. When the Select All button 1004 at the bottom of the list is pressed, all the projectors on the list are checked. When the Clear All button 1005 is pressed, all the projectors are unchecked. When the Next button 1006 is pressed in a state where the projector to be adjusted is checked, the process proceeds to the next step.

  At this time, a temporary ID is assigned to each selected projector. As shown in FIG. 9, numbers 1, 2,... Are sequentially assigned to the projectors checked from the list 1001 as temporary IDs (Temporary IDs). At this time, data as shown in FIG. 9 is stored in the storage unit 303 of the adjustment PC 300 as internal information of the application.

  10 and 11 are application screens in step S200 for setting the arrangement relationship of the projector selected in step S100. First, on the screen of FIG. 10, the arrangement of the selected projector with respect to the screen 400 is set. For example, as shown in the schematic diagram of FIG. 1, when five projectors are arranged side by side to form one image on the screen 400, the user sets “1” in the Height item 1103 and the Width item 1104. Enter “5” and “1” in the Stack item 1105, and press the Next button 1106. In the box 1101 of the display unit 307, the projector arrangement set in this way is indicated by five projector icons I arranged in the horizontal direction.

  As another example, when the screen 400 is divided into two vertical surfaces × three horizontal surfaces and two projectors are superimposed and projected on each surface to obtain brightness, the user can enter the item “Height”. “2” is input to 1103, “3” is input to the Width item 1104, and “2” is input to the Stack item 1105. In this example, since a total of 12 projectors are required, 12 projectors are connected and selected in advance in step S100.

  With the Restore button 1102 in FIG. 10, setting information is read when the adjustment has been performed previously. At the timing when the Next button 1106 is pressed, the adjustment PC 300 compares the number N of projectors necessary for setting (N = Height × Width × Stack) with the number of projectors selected in step S100, and the same number. Otherwise, an error message (not shown) is displayed to prompt readjustment.

  Next, the arrangement of the projectors is set on the application screen 1200 of FIG. At the timing when this screen is displayed, each projector projects a temporary ID number assigned to it on the screen 400 (FIG. 12). In the present embodiment, the projector 101 is a projector assigned with a temporary ID = 3 (IP address = 192.168.0.3, projector name = Name0824), and the projector 102 is a projector assigned with a temporary ID = 1 (IP Address = 192.168.0.1, projector name = Name4470), projector 103 is assigned a temporary ID = 4 (IP address = 192.168.0.4, projector name = Name0116), and projector 104 is temporary The projector assigned ID = 2 (IP address = 192.168.0.2, projector name = Name 1116), and the projector 105 is assigned the projector assigned temporary ID = 5 (IP address = 192.1). 8.0.5, is a projector name = Name1337).

  A box 1201 on the left side of the application screen 1200 in FIG. 11 is an area for setting the arrangement of each projector. First, the adjustment PC 300 projects only temporary ID = 1 from among the numbers of temporary IDs projected from each projector in a format different from other temporary IDs, and determines which projector the user should indicate. Make it easier to do. As a different format, for example, a red number is projected only for the temporary ID = 1, and a white number is projected otherwise. As another example of the different format, the temporary ID may be projected only for the projector to be instructed by the user, and the all white pattern may be projected for other cases. In the case of overlapping projection with a plurality of projectors at the same place, numbers do not overlap and it becomes easier to identify.

  The user confirms the projection position of the temporary ID = 1 projected on the screen 400 in a format different from other temporary IDs. As shown in FIG. 12, since the temporary ID = 1 is projected at the second projection position from the left of the screen 400, the user can select the corresponding cell in the left box 1201 of the application screen 1200 (second from the left). ) Is selected (clicked). Then, the number of temporary ID = 1 is set in the cell, and the position of the projector 102 with temporary ID = 1 is set. An underbar U is displayed in each cell of the box 1201 in FIG. 11, and a temporary ID set at the position of the underbar U is displayed.

  When the setting of the temporary ID = 1 is completed, the adjustment PC 300 then causes the projector 104 with the temporary ID = 2 to project the temporary ID = 2 in a format different from the other projectors. Similarly, when the user selects the corresponding fourth cell from the left in the box 1201, the temporary ID = 2 is displayed in the cell, and the position of the projector 104 is set. The remaining projector positions are set in the same procedure. FIG. 13 shows an application screen 1200 in a state where all the projector positions have been set.

  When the positions of all the projectors are set and the Next button 1202 is pressed and the arrangement of the projectors is confirmed, the position of the projector for each projector is a combination of row, column, and layer numbers. Arrangement information expressed by is attached. This arrangement information is the projector ID assigned in step S200 of FIG. In the example of the present embodiment, the leftmost projector 101 has (row, column, layer) = (1, 1, 1), and the rightmost projector 105 has (row, column, layer) = (1, 5, 1). ) Is assigned. Here, in the “layer”, in order to identify a plurality of projectors projected to the same position (row, column) in the case of superimposed projection, the same corresponding cell position in the left box 1201 of the application screen 1200 of FIG. Numbers 1, 2,... Are assigned in the set order. At this time, data as shown in FIG. 14 is stored in the storage unit 303 as internal information of the application.

  FIG. 15 shows an application screen 1300 in step S300 in which the cameras 201 and 202 used for adjustment are connected to the adjustment PC 300 and each camera can be identified by ID. When a search camera button 1301 is pressed, the adjustment PC 300 searches for a camera connected to a USB port or the like, and displays a list of camera IDs and model names in the list 1302 on the right. The camera ID is automatically assigned in order from Camera 1 in order to identify the camera found by the search.

  Next, the user checks a camera to be used for adjustment from the list 1302. When the Select All button 1303 at the bottom of the list is pressed, all the cameras on the list are checked. When the Clear All button 1304 is pressed, all cameras are unchecked. If the Next button 1305 is pressed with the camera to be used for adjustment checked, the process proceeds to the next step.

  FIGS. 17 to 19 are application screens 1400 in step S400 for designating which projector projection area is to be captured by each camera for a plurality of connected cameras. As shown in FIG. 16, in the actual camera arrangement in the present embodiment, ID = Camera2 is assigned to the left camera 201, and ID = Camera1 is assigned to the right camera 202. Further, it is assumed that the left camera 201 is disposed so as to capture the range projected by the projectors 101 to 103, and the right camera 202 is disposed so as to capture the range projected by the projectors 103 to 105.

  When switching to the application screen 1400 shown in FIG. 17, the initial state is determined. The camera arrangement type 1403 is determined by the size relationship between the number of projectors in the vertical direction and the number of horizontal directions. In the present embodiment, since the arrangement of the projector is 1 vertical × 5 horizontal, the arrangement type 1403 is set to “Horizontal”, and the information is displayed on the screen with radio buttons.

  Next, the initial value of the assigned range of each camera for the projector is determined. As the decision rule, in the order in which the camera IDs are assigned, the assigned range is from left to right when the camera arrangement type is “Horizontal”, and from upper to lower when the camera arrangement type is “Vertical”. Is set. In addition, the assigned range is set so that the number of projectors handled by each camera is equal, and adjacent cameras include at least one projector in common. In order to make the number of projectors equal, when using two cameras, the range of responsibility is determined so that each covers the same number of projectors as the initial value, It is desirable to do so. In addition, in this embodiment, the adjacent cameras include at least one projector in common means that both of the two cameras cover the projector 103 as the assigned range.

  According to the determination rule, in the present embodiment, the assigned range is determined so that one projector, that is, the projector 103 with column number 3 belongs to the assigned ranges of both the camera 201 (Camera 2) and the camera 202 (Camera 1). . The initial value of the assigned range is such that the camera 202 (Camera 1) is in charge of the projectors 101 to 103 with column numbers 1 to 3 and the camera 201 (Camera 2) is in charge of the projectors 103 to 105 with column numbers 3 to 5. It is determined. However, in an actual arrangement, as shown in FIG. 16, the camera 202 (Camera 1) captures the projection images of the projectors 103 to 105 on the right side, and the camera 201 (Camera 2) captures the projection images of the projectors 101 to 103. Thus, the user must operate the application screen 1400 to set the correct assigned range.

  Projector arrangement information 1401 is displayed on the left side of the application screen 1400 in FIG. When the projectors are arranged vertically 1 × 5 horizontally, column numbers 1 to 5 are assigned in order from the left. A radio button 1404 corresponding to the number of cameras used for adjustment and a list box 1405 indicating camera IDs are displayed on the right side of the projector arrangement information 1401. In order from the top, this corresponds to the assigned range from left to right (from top to bottom when the camera arrangement type is “Vertical”). In the initial state, the top radio button 1404 is ON, and the assigned range of the corresponding camera indicates that the column number is 1 to 3. Therefore, the column number 1 to 3 of the projector arrangement information 1401 is a frame F. being surrounded.

  At the same time, as shown in FIG. 16, in the actual projector, the column number assigned to each projector is projected at the timing when it is changed to the application screen of FIG. When the camera arrangement type is “Vertical”, the line number assigned to each projector is projected. In the case of stack projection, only the projector with the layer “1” projects the number, so that it is possible to make it easier to see without projecting a plurality of numbers at the same position.

  Further, in response to a command from the adjustment PC 300, each projector changes the format between the projector group surrounded by the frame F in the projector arrangement information 1401 in FIG. Project. In the example of FIG. 16, the projectors 101 to 103 that project a white projection image and the projectors 104 and 105 that project a light gray projection image are divided. Here, the white projected image is an example of the first format pattern, and the light gray ground projected image is an example of the second format pattern. The projection of the first format pattern and the second format pattern is performed according to an instruction from the pattern projection unit belonging to the control unit 305 of the adjustment PC 300.

  Returning to FIG. 17, the frame F indicating the assigned range of the projector arrangement information 1401 can be changed. In this embodiment, the initial values of the assigned range of the camera that is set to the top radio button 1404 and shoots the left projection image are column numbers 1 to 3, column numbers 1 to 3 are surrounded by a frame F, Furthermore, the background color of the portion of column number 3 is different from the others. The assigned range can be changed by changing the position of the column number having a different background color. For example, if there are obstacles, and the cameras are arranged such that the assigned range of the camera that shoots the left side is column numbers 1-2, the assigned range of the camera that shoots the right side is column numbers 2-5, Must be changed from column numbers 1 to 3 to column numbers 1 and 2. Specifically, by clicking on the area of column number 2 in the projector arrangement information 1401, the range surrounded by the frame F is changed to column numbers 1 and 2, and the background color of column number 2 becomes a different color from the others.

  The user can change the camera set to the radio button 1404. As shown in FIG. 17, a list box 1405 is displayed on the right side of the radio button 1404, and a Test Shot button 1406 is displayed on the right side thereof. When the upper Test Shot button 1406 corresponding to the selected radio button 1404 is pressed, a shooting instruction is given to the camera corresponding to “Camera1” set as the initial value, and the shooting data is displayed on the lower confirmation screen 1407. Is displayed. In this example, “Camera1” corresponds to the camera 202 arranged on the right side, and therefore the result of photographing the projected images of the projectors corresponding to the column numbers 3 to 5 is displayed. Here, the user compares the column numbers 1 to 3 surrounded by the frame F in the projector arrangement information 1401 with the captured image displayed on the confirmation screen 1407, so that the camera set with the initial value is the actual camera. It can be confirmed whether or not it matches with the arrangement. In this embodiment, as shown in FIG. 17, the captured images displayed on the confirmation screen 1407 are column numbers 3 to 5 and are different from the column numbers 1 to 3 surrounded by the frame F. The camera corresponding to the uppermost radio button 1404 needs to be changed.

  In order to change the set camera, the user presses the list box 1405 displayed as “Camera 1”, and selects “Camera 2” from the displayed pull-down menu. Then, the camera arrangement information corresponding to each of “Camera 1” and “Camera 2” is switched. In this state, when the user presses the upper Test Shot button 1406 once again, as shown in FIG. 18, shooting data shot by the camera 201 corresponding to “Camera 2” is displayed on the lower confirmation screen 1407. As shown in FIG. 16, the camera 201 captures the column numbers 1 to 3 projected by the projectors 101 to 103 onto the screen 400, so that the confirmation screen 1407 has a column number 1 as shown in FIG. 18. -3 captured images are displayed. The user can check when the column numbers 1 to 3 surrounded by the frame F in the projector arrangement information 1401 match the column numbers 1 to 3 displayed on the confirmation screen 1407.

  Further, FIG. 19 shows a state when the lower radio button 1404 is turned ON and the lower Test Shot button 1406 is pressed. In order to indicate that the assigned range of the corresponding camera, that is, the right camera is column numbers 3 to 5 at the timing when the lower radio button is turned ON, column numbers 3 to 5 of the projector arrangement information 1401 are frame F. Surrounded by At the same time, the adjustment PC 300 causes each projector to change the column number format for projection. Specifically, the projectors 103 to 105 corresponding to the column numbers 3 to 5 that are the assigned range of the selected camera project a white projection image (first format pattern), and the other projectors 101 and 102 Project a light gray ground projection image (second format pattern). When the lower Test Shot button 1406 is pressed, a shooting instruction is issued to the camera 202 corresponding to “Camera1” displayed in the lower list box 1405, and shooting data is displayed on the lower confirmation screen 1407. The user can confirm that the column numbers 3 to 5 surrounded by the frame F in the projector arrangement information 1401 match the column numbers 3 to 5 displayed on the confirmation screen 1407.

  The Restore button 1402 is a button for reading setting information when adjustment has been performed previously. When the assigned ranges of all the cameras have been confirmed, the user presses the Next button 1408 to confirm the correspondence. In the application, data as shown in FIG. 20 is stored in the storage unit 303 as internal information. That is, the assigned range of the camera (ID = Camera2) is column numbers 1 to 3 (Start Index = 1, End Index = 3), and the assigned range of the camera (ID = Camera1) is column numbers 3 to 5 (Start Index = 3, Start Index = 3). It is stored that End Index = 5). Here, the radio button 1404 and the list box 1405 are examples of the imaging device selection unit. The projector arrangement information 1401 is an example of a shooting range setting unit. The confirmation screen 1407 is an example of a captured image display unit.

  FIG. 21 shows an application screen 1500 for adjusting camera exposure, white balance, and focus. When the Auto Setup button 1501 is pressed, automatic adjustment is performed for all connected cameras. Specifically, an all white pattern is projected from the projector, and parameters such as the exposure time, ISO value, and aperture are adjusted so that the overexposure does not occur even when the state is photographed by the camera. Next, the white balance is adjusted based on the projected all white pattern, and finally, a focus adjustment is performed by projecting a pattern that is easy to focus, such as a cross hatch.

  In the parameter confirmation area 1502 of the camera, the automatically adjusted result is displayed. It is also possible to manually set a desired parameter by turning on the check box of Manual Setup. When the adjustment is completed, the Next button 1503 is pressed to proceed to the next step.

  FIG. 22 shows an application screen 1600 in step S500 for setting an area of the screen 400 on which an image is projected and an edge blending width between adjacent projectors. At the timing of displaying the application screen, each projector projects an image that displays a cursor for designating a screen area (FIG. 23).

  The number of cursors indicating the area of the screen is specified in the horizontal direction and the vertical direction in a numeric input box 1601 of “Cross Currs H:” and a numeric input box 1602 of “Cross Currs V:”. In the present embodiment, since the screen 400 is projected by the five projectors 101 to 105 arranged in the horizontal direction, the screen is specified using six cursors in the horizontal direction and two cursors in the vertical direction. And In the cursor selection area 1603, the user selects a cursor to be moved, and moves the cursor position by operating the mouse or the keyboard. Then, the cursor projected on the screen 400 moves from the projector shown in FIG. 23 in conjunction with each other, so that the position of each cursor can be adjusted so as to surround the actual screen 400 at equal intervals.

  Returning to FIG. 22, next, the edge blending width between the projectors is designated. In the “Horizontal” number input box 1604, a width for performing edge blending in units of pixels is input to the left and right overlapping portions of the projection area when the projectors are arranged in the horizontal direction. Similarly, in the “Vertical” number input box 1605, a width for edge blending in units of pixels is input to the upper and lower overlapping portions of the projection area when the projectors are arranged in the vertical direction. You can also change the value using the slider bar to the right of each number entry box. It is also possible to set the application to automatically calculate the optimum width by turning on the Auto check box above each number input box.

  A Restore button 1607 reads information on the number of cursors, the cursor position, and the edge blending width when adjustment has been performed previously. A Reset button 1608 returns the values of the cursor position and the edge blending width to the initial values. When all the settings are completed, the Start button 1606 is pressed, and the process proceeds to the automatic execution phase (S600 to S1000). During automatic execution, an application screen 1700 including a progress bar 1701 as shown in FIG. 24 is displayed to notify the user of the progress of automatic execution each time. When the Abort button 1702 is pressed, the process is interrupted.

[1-3. Effect]
As described above, in the present embodiment, the projection image adjustment system includes the plurality of projectors 101 to 105, the plurality of cameras 201 and 202, the adjustment PC 300, and the screen 400. The plurality of cameras 201 and 202 capture pattern images projected by the projectors in charge. When the adjustment PC 300 selects one of a plurality of cameras and sets the projection range of the projector in charge, the first format pattern is projected to the projector set to the projection range, and the second format is set to the projector that is not set to the projection range. The format pattern is projected. Then, the adjustment PC 300 displays the image data captured by the selected camera.

  This allows the user to easily check whether the selected camera's assigned range includes the specified projector projection range, and if not, the camera position adjustment, selection change, or projector projection range. Can be easily performed.

(Other embodiments)
In the above embodiment, as shown in FIG. 16, two types of format patterns are used, with a white projected image as a first format pattern and a light gray ground projected image as a second format pattern. Alternatively, only a white background projection image may be projected on the screen as one format pattern, and a non-projection area in which no projection image is projected may be formed on other areas of the screen. In that case, the camera 201 captures the projection images of the column numbers 1 to 3, and the camera 202 captures the projection image of the column number 3 and the non-projection area of the screen. This also tells which camera is in charge of which projection area.

  In the above-described embodiment, as shown in FIG. 1, the projection image adjustment system that captures the projection images of the five projectors with the two cameras has been described. The number of projectors and cameras is not limited to this. For example, the projection image adjustment system may be configured so that the projection images of seven projectors arranged in a row in the horizontal direction are captured by three cameras. In this case, the assigned range of the camera can be divided into three projector groups with column numbers 1 to 3, column numbers 3 to 5, and column numbers 5 to 7. The radio button 1404, the list box 1405, and the Test Shot button 1406 shown in FIG. 17 are displayed in three rows. When the upper camera is set, the column numbers 1 to 3 displayed in the projector arrangement information 1401 are surrounded by the frame F, and the projector corresponding to the column numbers 1 to 3 projects the first format pattern on the screen. Similarly, when setting the middle camera, column numbers 3 to 5 are surrounded by the frame F, and the projector corresponding thereto projects the first format pattern on the screen and sets the lower camera. Numbers 5 to 7 are surrounded by a frame F, and the projector corresponding thereto projects the first format pattern onto the screen.

  As described above, the embodiments have been described as examples of the technology in the present disclosure. For this purpose, the accompanying drawings and detailed description are provided.

  Accordingly, among the components described in the accompanying drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to illustrate the above technique. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description.

  Moreover, since the above-mentioned embodiment is for demonstrating the technique in this indication, a various change, replacement, addition, abbreviation, etc. can be performed in a claim or its equivalent range.

  The present disclosure is applicable to image display using a projection display device.

DESCRIPTION OF SYMBOLS 10 Projection image adjustment system 101-105 Projector 201,202 Camera 300 PC for adjustment
400 screen 500 network hub 600 wireless access point

Claims (4)

A plurality of projection display devices that project a projection image onto a projection surface; a first imaging device and a second imaging device that capture the projection image displayed on the projection surface; the plurality of projection display devices; A projection image adjustment system comprising: 1 imaging device; and a control device that controls the second imaging device,
The controller is
An imaging device selection unit for selecting the first imaging device or the second imaging device;
The first charge range of the projection display device in which the first imaging device takes charge and the second image pickup device take an image so as to include at least one projection display device in common among the plurality of projection display devices. A shooting range setting unit for setting a second charge range of the projection display device in charge of
A pattern projection unit that projects a first format pattern on the projection display device corresponding to the first assigned range or the second assigned range based on the selection of the imaging device selection unit;
A captured image display unit that displays a captured image captured by the first imaging device or a captured image captured by the second imaging device based on the selection of the imaging device selection unit;
A projection image adjustment system comprising: The pattern projection unit causes at least one projection display device adjacent to the projection display device that projects the first format pattern to project a second format pattern different from the first format pattern;
The projection image adjustment system according to claim 1. A plurality of projection display devices project a projection image on a projection surface, the projection image displayed on the projection surface is photographed by the first imaging device and the second imaging device, and the projection surface is projected on the projection surface based on the photographed images. A projected image adjustment method for adjusting the projected image to be displayed, comprising:
An imaging device selection step of selecting the first imaging device or the second imaging device;
The first charge range of the projection display device in which the first imaging device takes charge and the second image pickup device take an image so as to include at least one projection display device in common among the plurality of projection display devices. A charge range setting step for setting a second charge range of the projection display device in charge of;
A pattern projecting step of causing the projection display device corresponding to the first assigned range or the second assigned range to project a first format pattern based on the selection of the imaging device selecting step;
A captured image display step of displaying a captured image captured by the first imaging device or a captured image captured by the second imaging device based on the selection of the imaging device selection step;
Projection image adjustment method including In the pattern projection step, at least one projection display device adjacent to the projection display device that projects the first format pattern is caused to project a second format pattern different from the first format pattern;
The projection image adjustment method according to claim 3.