JP6620979B2 - Portable terminal, projection system, control method and program for projection system - Google Patents

Description

  The present invention relates to projection mapping.

  A so-called projection mapping technique for projecting an image on the surface of a structure is known (for example, Patent Document 1). Generally, in projection mapping, content is created by mapping and transforming a projected image using three-dimensional information indicating the three-dimensional shape of a structure that projects the image. Therefore, the creation of the content for projection mapping requires the strict measurement of the structure, that is, the environment for performing the projection mapping, and the operation of the video editing software.

JP 2013-192189 A

  Conventionally, the creation of projection mapping content has required a lot of time and work steps. Since a lot of equipment and man-hours are required, for example, it was difficult to carry out small-scale projection mapping easily. Conventionally, since the location where the projection mapping is viewed is different from the installation location of the projector, it is necessary to perform image correction according to the viewing location when correcting the projected image. As a result, it was difficult to change the installation position and viewing location of the projector at a later date.

  In contrast, the present invention provides a technique for performing projection mapping more easily.

The present invention is obtained using an imaging unit that captures an image of a structure on which an image is projected by a projector, and an image that is captured by the imaging unit when a predetermined test pattern is projected by the projector. , An acquisition means for acquiring video data generated using mapping information indicating video distortion in the structure, and a first transmission means for transmitting the video data acquired by the acquisition means to the projector. Provide mobile devices.
According to this portable terminal, projection mapping can be performed more easily.

The portable terminal includes: a second transmission unit configured to transmit a video captured by the imaging unit when the test pattern is projected by the projector to a server having a calculation unit that calculates the mapping information from the video. And the acquisition means may acquire video data generated using mapping information calculated by the server.
According to this portable terminal, it is possible to reduce the load on the portable terminal as compared with the case where the portable terminal has a calculation means.

The portable terminal may include a calculation unit that calculates the mapping information, and the acquisition unit may acquire video data generated using the mapping information calculated by the calculation unit.
According to this portable terminal, the load on the server and the communication amount can be reduced as compared with the case where the server has calculation means.

  The portable terminal has a third transmission unit that transmits the mapping information to a server having a generation unit that generates video data using the mapping information, and the acquisition unit acquires the video data from the server. May be.

The portable terminal may include a generation unit that generates video data using the mapping information, and the acquisition unit may acquire the video data from the generation unit.
According to this portable terminal, it is possible to reduce the load on the server as compared with the case where the server has a generation unit.

The portable terminal may include display means for displaying the video imaged by the imaging means.
According to this portable terminal, the captured video can be confirmed more easily.

The portable terminal includes first receiving means for receiving designation of at least a part of the image displayed on the display means, and the acquisition means is an area for which designation is accepted by the first receiving means. You may acquire the image | video produced | generated using the mapping information calculated using these coordinates.
According to this portable terminal, a desired image can be projected onto a designated area.

The portable terminal has a second accepting unit that accepts a drawing instruction of an image object to be superimposed on the video displayed on the display unit, and the obtaining unit receives the drawing instruction accepted by the second accepting unit. Video data for displaying a video including such an image object may be acquired.
According to this portable terminal, the image object to be mapped can be edited while viewing the video displayed on the display means.

The test pattern may include a plurality of feature points.
According to this portable terminal, information regarding the shape of the structure can be acquired from a plurality of feature points.

Further, the present invention is obtained using projection means for projecting an image of a predetermined test pattern onto a structure, and an image taken with a portable terminal when the test pattern is projected onto the structure, There is provided a projector including a receiving unit that receives an image generated using mapping information indicating image distortion in the structure, and a control unit that causes the projection unit to project the image received by the receiving unit.
According to this projector, projection mapping can be performed more easily.

Furthermore, the present invention includes a projector and a portable terminal that communicates with the projector, the projector includes a projecting unit that projects an image of a predetermined test pattern onto a structure, and the portable terminal includes the structure Mapping information indicating distortion of the image in the structure obtained by using an imaging unit that captures an image of the body and an image captured by the imaging unit when a predetermined test pattern is projected by the projector Acquisition means for acquiring video data generated using the communication means, and communication means for transmitting the video data acquired by the acquisition means to the projector, wherein the projector is further transmitted by the communication means. Receiving means for receiving the video data; and a video indicated by the video data received by the receiving means. The to provide a projection system and a control means for projecting the projection means.
According to this projection system, projection mapping can be performed more easily.

Further, the present invention is directed to a step in which the projector projects an image of a predetermined test pattern onto the structure, a step in which a photographing unit of the portable terminal photographs an image of the structure, Obtaining the mapping information indicating the distortion of the image in the structure obtained using the image captured by the imaging means when the image is projected, and the portable terminal using the mapping information Acquiring the generated video data; the portable terminal transmitting the acquired video data to the projector; the projector receiving the transmitted video data; A projection system in which a projector projects an image indicated by the received image data. To provide a control method.
According to this control method, projection mapping can be performed more easily.

Further, according to the present invention, a step in which the photographing unit photographs an image of a structure on which a video is projected by a projector is projected on a computer having a photographing unit for photographing an image, and a predetermined test pattern is projected by the projector. A step of acquiring video data generated by using mapping information indicating a distortion of the video in the structure, which is sometimes obtained using the video shot by the shooting means, and the acquired video data And a program for executing the step of transmitting to the projector.
According to this program, projection mapping can be performed more easily.

1 is a diagram illustrating a configuration of a projection system 1 according to a first embodiment. 2 is a diagram illustrating a hardware configuration of the projector 10. FIG. The figure which illustrates the hardware constitutions of the portable terminal 20. The figure which illustrates the hardware constitutions of the server 30. 3 is a sequence chart illustrating an operation according to the first embodiment of the projection system 1. The figure which illustrates the image | video displayed. The figure which illustrates designation | designated of an area | region. The figure which illustrates the structure by which the picture according to mapping picture data was projected. The figure which illustrates the structure of the projection system 2 which concerns on 2nd Embodiment. 10 is a sequence chart illustrating an operation according to the second embodiment of the projection system 2; The figure which illustrates UI screen. The figure which illustrates the structure by which the picture according to mapping picture data was projected.

1. First embodiment 1-1. Configuration FIG. 1 is a diagram illustrating a configuration of a projection system 1 according to the first embodiment. The projection system 1 is a system for performing projection mapping. The projection system 1 includes a projector 10, a mobile terminal 20, and a server 30. The projector 10 projects an image. The mobile terminal 20 is a device for generating content projected by the projector 10, that is, video data, and is a client device in the projection system 1. The server 30 is a device that generates video data in cooperation with the mobile terminal 20, and is a server device in the projection system 1.

  The projection system 1 includes a projection unit 11, a reception unit 12, a control unit 13, a photographing unit 21, a display unit 22, a reception unit 23, a transmission unit 24, an acquisition unit 25, a transmission unit 26, a calculation unit 31, an acquisition unit 32, and a storage. Means 33, generation means 34, and transmission means 35 are provided. In this example, the projection unit 11, the reception unit 12, and the control unit 13 are in the projector 10, and the imaging unit 21, the display unit 22, the reception unit 23, the transmission unit 24, the acquisition unit 25, and the transmission unit 26 are in the portable terminal 20. The calculation unit 31, the acquisition unit 32, the storage unit 33, the generation unit 34, and the transmission unit 35 are mounted on the server 30, respectively.

  The projection unit 11 of the projector 10 projects an image of a predetermined test pattern onto a structure (not shown). The structure refers to a physically substantial object, and includes at least one of a building such as a building or a house and a movable object such as a block or a box. The photographing unit 21 of the portable terminal 20 photographs an image of the structure on which the test pattern is projected by the projector 10. The display means 22 displays the video imaged by the imaging means. The accepting unit 23 (an example of the first accepting unit) accepts a user operation input, for example, designation of at least a part of the image displayed on the display unit 22. The transmission unit 24 (an example of the second transmission unit) stores video data indicating the video imaged by the imaging unit 21 and information (hereinafter referred to as “region information”) for specifying an area that the reception unit 23 has received designation. 30.

  The calculation means 31 of the server 30 calculates mapping information using the video data and area information transmitted from the mobile terminal 20. The mapping information refers to information indicating image distortion in the structure. The acquisition unit 32 acquires the mapping information calculated by the calculation unit 31. The storage means 33 stores video data that is the basis of projection mapping. This video data is, for example, data indicating a moving image or a still image. This video data is data indicating a video that is projected as intended when projected onto a plane. The generation unit 34 converts the video data stored in the storage unit 33 according to the distortion of the structure using the mapping information acquired by the acquisition unit 32. That is, the generation unit 34 generates video data for projection mapping. The transmission unit 35 transmits the video data generated by the generation unit 34 to the mobile terminal 20.

  The acquisition unit 25 of the portable terminal 20 acquires video data for projection mapping from the server 30. The transmission unit 26 (an example of a first transmission unit) transmits the video data acquired by the acquisition unit 25 to the projector 10. The receiving unit 12 of the projector 10 receives video data from the mobile terminal 20. The control unit 13 controls the projection unit 11 to project an image according to the video data received by the reception unit 12.

  FIG. 2 is a diagram illustrating a hardware configuration of the projector 10. The projector 10 includes a CPU (Central Processing Unit) 100, a ROM (Read Only Memory) 101, a RAM (Random Access Memory) 102, an IF unit 104, an image processing circuit 105, a projection unit 106, and an operation panel 107.

  The CPU 100 is a control device that controls each unit of the projector 10. The ROM 101 is a non-volatile storage device that stores various programs and data. The RAM 102 is a volatile storage device that stores data, and functions as a work area when the CPU 100 executes processing.

  The IF unit 104 is an interface that mediates exchange of signals or data with an external device. The IF unit 104 is a terminal (for example, VGA terminal, USB terminal, wired LAN interface, S terminal, RCA terminal, HDMI (High-Definition Multimedia Interface: registered trademark) terminal) for exchanging signals or data with an external device. Microphone terminal) and a wireless LAN interface. These terminals may include a video output terminal in addition to the video input terminal. The IF unit 104 may accept input of video signals from a plurality of different video supply devices.

  The image processing circuit 105 performs predetermined image processing (eg, size change, keystone correction, etc.) on the input video signal (hereinafter referred to as “input video signal”).

  The projection unit 106 projects an image on a projection surface such as a screen or a wall surface in accordance with a video signal subjected to image processing. The projection unit 106 includes a light source, an optical modulator, and an optical system (all not shown). The light source includes a lamp such as a high-pressure mercury lamp, a halogen lamp, or a metal halide lamp, or a solid light source such as an LED (Light Emitting Diode) or a laser diode, and a drive circuit thereof. The optical modulator is a device that modulates light emitted from a light source according to a video signal, and includes, for example, a liquid crystal panel or a DMD (Digital Mirror Device) and a drive circuit thereof. The liquid crystal panel may be either a transmission type or a reflection type. The optical system includes an element that projects light modulated by the light modulator onto a screen, and includes, for example, a mirror, a lens, and a prism. A light source and a light modulator may be provided for each color component.

  The operation panel 107 is an input device for a user to input an instruction to the projector 10 and includes, for example, a keypad, buttons, or a touch panel.

  In the projector 10, the functions shown in FIG. 1 are implemented when the CPU 100 executes a program stored in the ROM 101. The projection unit 106 is an example of the projection unit 11. The IF unit 104 is an example of the receiving unit 12. The CPU 100 is an example of the control unit 13.

  FIG. 3 is a diagram illustrating a hardware configuration of the mobile terminal 20. The portable terminal 20 is a computer device having a CPU 200, a memory 201, a storage 202, an input device 203, a display device 204, a communication IF 205, and a camera 206, for example, a smartphone or a tablet terminal. The CPU 200 is a device that performs various calculations and controls other hardware elements. The memory 201 is a storage device that stores codes and data used when the CPU 200 executes processing, and includes, for example, a ROM and a RAM. The storage 202 is a non-volatile storage device that stores various data and programs, and includes, for example, an HDD (Hard Disk Drive) or a flash memory. The input device 203 is a device for inputting information to the CPU 200, and includes, for example, a touch screen and buttons. The display device 204 is a device that outputs an image, and includes, for example, a liquid crystal display or an organic EL display. The communication IF 205 is an interface that communicates with the server 30 via a network (not shown). This network includes, for example, at least one of the Internet, a wireless LAN, and a mobile communication network. The camera 206 is a device that captures an image, and includes, for example, a lens, a CMOS sensor, and an image processing circuit.

  In this example, the storage 202 stores a program for causing a computer device to function as a client device in the projection system 1 (hereinafter referred to as “client program”). The functions shown in FIG. 1 are implemented by the CPU 200 executing the client program. The camera 206 controlled by the CPU 200 executing the client program is an example of the photographing unit 21, the display device 204 is an example of the display unit 22, the input device 203 is an example of the receiving unit 23, and the communication IF 205 is It is an example of the transmission means 24, the acquisition means 25, and the transmission means.

  FIG. 4 is a diagram illustrating a hardware configuration of the server 30. The server 30 is a computer device having a CPU 300, a memory 301, a storage 302, and a communication IF 305. The CPU 300 is a device that performs various calculations and controls other hardware elements. The memory 301 is a storage device that stores codes and data used when the CPU 300 executes processing, and includes, for example, a ROM and a RAM. The storage 302 is a non-volatile storage device that stores various data and programs, and includes, for example, an HDD (Hard Disk Drive) or a flash memory. The communication IF 305 is an interface that communicates with the mobile terminal 20 via a network (not shown).

  In this example, the storage 302 stores a program for causing a computer device to function as a server device in the projection system 1 (hereinafter referred to as “server program”). The functions shown in FIG. 1 are implemented when the CPU 300 executes the server program. The CPU 300 executing the server program is an example of the calculating unit 31, the acquiring unit 32, and the generating unit 34. The communication IF 305 controlled by the CPU 300 executing the server program is an example of the transmitting unit 35. The memory 301 or the storage 302 is an example of the storage unit 33.

1-2. Operation FIG. 5 is a sequence chart illustrating an operation according to the first embodiment of the projection system 1. In the following description, the processing of the mobile terminal 20 is based on the client program, and the processing of the server 30 is based on the server program. Before the start of the sequence of FIG. 5, the projector 10 is installed at a position where an image is projected onto a certain structure.

  In step S10, the projection unit 106 of the projector 10 projects a test pattern image on the structure. The test pattern is an image for correcting distortion of the image due to the shape of the surface on which the image is projected. Specifically, the test pattern is a still image image including a plurality of feature points such as a lattice pattern. The video data of the test pattern is stored in the ROM 101. Alternatively, the test pattern video data may be supplied from the mobile terminal 20.

  In step S <b> 11, the client program of the mobile terminal 20 captures an image of the test pattern projected on the structure using the camera 206. The video imaged here is a still image. In step S <b> 12, the client program displays the captured video on the display device 204. In step S <b> 13, the client program accepts designation of an area for performing projection mapping in the displayed video.

  FIG. 6A is a diagram illustrating an image to be displayed, and FIG. 6B is a diagram illustrating designation of a region. An image photographed by the camera 206 includes a test pattern projected on the structure O and the surrounding structures. The user designates area A as an area for projection mapping in the video. Region A is specified using a touch screen.

  Refer to FIG. 5 again. In step S <b> 14, the client program transmits video data indicating the captured video (hereinafter referred to as “captured video data”) and information specifying the region A (hereinafter referred to as “region information”) to the server 30.

  In step S <b> 15, the server program of the server 30 calculates mapping information based on the captured video data and area information received from the mobile terminal 20. The mapping information may be in any format as long as it is information indicating the correspondence between pixels of the input video (video to be displayed) and the output video (video projected by the projector 10).

  In step S16, the server program uses the mapping information calculated in step S15 for the video indicated by one content video data selected from the video data (hereinafter referred to as “content video data”) stored in the database. Projection conversion is performed to generate video data for projection mapping (hereinafter referred to as “mapping video data”). In step S17, the server program transmits the generated mapping video data to the mobile terminal 20 that is the transmission source of the captured video data.

  In step S <b> 17, the client program of the mobile terminal 20 receives the mapping video data from the server 30. The client program converts the received mapping video data into data that can be processed by the projector 10. In step S <b> 18, the client program transmits the converted mapping video data to the projector 10.

  In step S <b> 19, the projector 10 projects an image according to the mapping image data received from the mobile terminal 20.

  FIG. 7 is a diagram illustrating a structure on which an image according to the mapping image data is projected. When viewed from the position of the mobile terminal 20, the image is displayed correctly (with reduced distortion). As described above, according to the present embodiment, an image from a specific viewing position can be adjusted to a shape without distortion.

2. Second embodiment 2-1. Configuration FIG. 8 is a diagram illustrating a configuration of the projection system 2 according to the second embodiment. The image projected on the structure in the projection system 2 is stored in the server 30 in advance. However, in the second embodiment, the mobile terminal 20 receives an image object drawing instruction, and the projector 10 displays the image including the image object. Project. In the following description, it demonstrates centering on the element which is different from 1st Embodiment.

  The projection system 2 includes a projection unit 11, a reception unit 12, a control unit 13, a photographing unit 21, a display unit 22, a transmission unit 24, an acquisition unit 25, a calculation unit 31, a transmission unit 36, a reception unit 27, and a generation unit 28. Have. In this example, the projection unit 11, the reception unit 12, and the control unit 13 are in the projector 10, and the imaging unit 21, the display unit 22, the transmission unit 24, the acquisition unit 25, the reception unit 27, and the generation unit 28 are in the portable terminal 20. The calculation means 31 and the transmission means 36 are mounted on the server 30, respectively.

  The transmission unit 24 of the portable terminal 20 transmits video data (“photographed video data”) indicating the video captured by the imaging unit 21 to the server 30. The calculation means 31 of the server 30 calculates mapping information using the video data transmitted from the mobile terminal 20. The transmission unit 36 transmits the mapping information calculated by the calculation unit 31 to the portable terminal 20.

  The receiving unit 27 (an example of the second receiving unit) of the mobile terminal 20 receives an image object drawing instruction from the user. An image object is a set of image elements. Image elements refer to points, lines, regions, and their colors. The image object is, for example, a polygon, an ellipse, or a line. Alternatively, the image object may include a handwritten line drawing.

  The generation unit 28 generates video data including the image object whose drawing has been received by the reception unit 27 using the mapping information received from the server 30. The acquisition unit 25 acquires the video data generated by the generation unit 28.

2-2. Operation FIG. 9 is a sequence chart illustrating an operation according to the second embodiment of the projection system 2. In step S20, the projection unit 106 of the projector 10 projects the test pattern image on the structure. In step S <b> 21, the client program of the mobile terminal 20 captures an image of the test pattern projected on the structure using the camera 206. In step S <b> 22, the client program displays the captured video on the display device 204. In step S23, the client program transmits the shooting data to the server.

  In step S <b> 24, the server program of the server 30 calculates mapping information using the shooting data received from the mobile terminal 20. In step S <b> 25, the server program transmits the calculated mapping information to the mobile terminal 20. In step S26, the client program of the portable terminal 20 accepts drawing of an image object.

  FIG. 10 is a diagram illustrating a UI screen. Where an image captured using the camera 206 is displayed, the user can draw an image object on the captured image (superimposed on the captured image) using his / her confidence finger or stylus pen P. . Alternatively, the user can specify the position, size, and orientation of the prescribed image object and paste it on the captured video. For editing the image object here, a known image editing software technique can be used.

  Refer to FIG. 9 again. In step S27, the client program generates mapping video data including an image object drawn in accordance with an instruction input via the UI screen. This mapping video data includes an image object that has undergone mapping conversion using mapping information received from the server 30.

  In step S <b> 28, the client program transmits mapping video data to the mobile terminal 20. In step S <b> 29, the projector 10 displays a video according to the mapping video data received from the mobile terminal 20. The video displayed here includes the image object edited in response to the user's operation input in step S26. This image object also has a positional relationship and a size relationship with the background (structure O) specified via the UI screen. That is, the image object drawn by the user via the mobile terminal 20 is actually projection mapped almost interactively.

  FIG. 11 is a diagram illustrating a structure on which an image according to the mapping image data is projected. When viewed from the position of the mobile terminal 20, the image is displayed correctly (with reduced distortion). As described above, according to the present embodiment, it is possible to interactively edit an image object to be projection mapped to a structure. At this time, according to the present embodiment, it is possible to adjust an image from a specific viewing position to a shape without distortion.

3. Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, some modifications will be described. Two or more of the following modifications may be used in combination.

  The sharing of functions in the mobile terminal 20 and the server 30 is not limited to those exemplified in the first embodiment and the second embodiment. The functions of the portable terminal 20 and the server 30 include a function of calculating mapping information and a function of generating mapping video data. In the first embodiment, the example in which the server 30 has these two functions (the calculation unit 31 and the generation unit 34) has been described. In the second embodiment, the example in which the mobile terminal 20 includes the generation unit 28 and the server 30 includes the calculation unit 31 has been described. For example, these two functions may be integrated in the mobile terminal 20. Alternatively, the mobile terminal 20 may have a function of calculating mapping information, and the server 30 may have a function of generating mapping video data. When both the function for calculating mapping information and the function for generating mapping video data are implemented in a device other than the mobile terminal 20, these two functions may be implemented in two different servers. . When the mobile terminal 20 has a function of calculating mapping information, the mobile terminal 20 includes a transmission unit (an example of a third transmission unit) that transmits the mapping information to the server 30.

  The video shown by the mapping video data is not limited to those exemplified in the first embodiment and the second embodiment. In the first embodiment, an instruction to draw an image object may be accepted in addition to the area designation, and the server 30 may generate mapping video data based on this instruction. In the second embodiment, the mobile terminal 20 designates an area for displaying a moving image or a still image stored in the mobile terminal 20 on the UI screen, and the mobile terminal 20 displays mapping video data for displaying the moving image or the still image in the area. It may be generated.

  Although an example in which the captured video is a still image has been described in the embodiment, the captured video may be a moving image. That is, the mobile terminal 20 may continue to capture the video of the structure O as a moving image and display the captured image on the display device 204 in real time.

  In the second embodiment, after transmitting the mapping video data including the image object drawn on the UI screen to the projector 10, the client program may stop displaying the image object drawn on the mobile terminal 20. . For example, in the case where the video of the structure O is being continuously captured via the camera 206 (as a moving image), the image projected on the structure O and the image drawn on the UI screen may overlap. Yes, this example avoids this situation.

  The projector 10 may store the mapping video data received from the mobile terminal 20 in the RAM 102 or the like. According to this example, an image can be projected even after the connection with the mobile terminal 20 is disconnected.

  When the function for generating the mapping video data is implemented in a server on the network, the projector 10 may acquire the mapping video data without using the mobile terminal 20. For example, the mobile terminal 20 may notify the projector 10 of a URL for downloading the mapping video data, and the projector 10 may acquire the mapping video data from this URL.

  The hardware configuration of the apparatus constituting the projection system is not limited to that exemplified in the embodiment. For example, the mobile terminal 20 may not have a camera built therein, and may acquire a captured video from a camera that is an external device.

  Programs executed in the projector 10, the portable terminal 20, and the server 30 may be provided in various stored states such as an optical disk and a semiconductor memory. Alternatively, these programs may be downloaded and installed via a network such as the Internet.

DESCRIPTION OF SYMBOLS 1 ... Projection system, 2 ... Projection system, 10 ... Projector, 11 ... Projection means, 12 ... Reception means, 13 ... Control means, 20 ... Portable terminal, 21 ... Photographing means, 22 ... Display means, 23 ... Acceptance means, 24 ... Transmission means 25 ... Acquisition means 26 ... Transmission means 27 ... Reception means 28 ... Generation means 30 ... Server 31 ... Calculation means 32 ... Acquisition means 33 ... Storage means 34 ... Generation means 100 ... CPU ... 101 ... ROM 102 ... RAM 104 ... IF unit 105 ... Image processing circuit 106 ... Projection unit 107 ... Operation panel 200 ... CPU 201 ... Memory 202 ... Storage 203 ... Input device 204 ... Display device, 205 ... communication IF, 206 ... camera, 300 ... CPU, 301 ... memory, 302 ... storage, 306 ... communication IF

Claims (13)

Photographing means for photographing the image of the structure on which the image is projected by the projector;
Acquire video data generated using mapping information indicating video distortion in the structure obtained using video captured by the imaging means when a predetermined test pattern is projected by the projector Acquisition means to
First transmission means for transmitting the video data acquired by the acquisition means to the projector ;
The image captured by the imaging means when said test pattern is projected by the projector, have a second transmitting means for transmitting to a server having a calculating means for calculating the mapping information from the video,
The acquisition means is a portable terminal that acquires video data generated using mapping information calculated by the server . Photographing means for photographing the image of the structure on which the image is projected by the projector;
Acquire video data generated using mapping information indicating video distortion in the structure obtained using video captured by the imaging means when a predetermined test pattern is projected by the projector Acquisition means to
First transmission means for transmitting the video data acquired by the acquisition means to the projector ;
Calculation means for calculating the mapping information;
Third transmission means for transmitting the mapping information to a server having generation means for generating video data using the mapping information;
Have
The acquisition unit is a portable terminal that acquires video data generated using the mapping information calculated by the calculation unit from the server . Generating means for generating video data using the mapping information;
The portable terminal according to claim 1 , wherein the acquisition unit acquires the video data from the generation unit. The mobile terminal according to any one of claims 1 to 3 , further comprising display means for displaying an image photographed by the photographing means. First receiving means for receiving designation of at least a part of the image displayed on the display means;
The portable terminal according to claim 4 , wherein the acquisition unit acquires a video generated using mapping information calculated using coordinates of a region whose designation is received by the first reception unit. . Second receiving means for receiving a drawing instruction of an image object to be superimposed on the video displayed on the display means;
The portable terminal according to claim 4 or 5 , wherein the acquisition unit acquires video data for displaying a video including an image object related to a drawing instruction received by the second reception unit. The portable terminal according to any one of claims 1 to 4 , wherein the test pattern includes a plurality of feature points. A projector,
A portable terminal that communicates with the projector,
The projector is
A projection means for projecting an image of a predetermined test pattern onto the structure;
The portable terminal is
Photographing means for photographing an image of the structure;
Acquire video data generated using mapping information indicating video distortion in the structure obtained using video captured by the imaging means when a predetermined test pattern is projected by the projector Acquisition means to
Communication means for transmitting the video data acquired by the acquisition means to the projector ;
A second transmission means for transmitting an image captured by the imaging means when the test pattern is projected by the projector to a server having a calculation means for calculating the mapping information from the image ;
The projector further includes:
Receiving means for receiving the video data transmitted by the communication means;
An image represented by the image data received by the receiving means have a control means for projecting the projection means,
The acquisition unit is a projection system that acquires video data generated using mapping information calculated by the server . A projector,
A portable terminal that communicates with the projector,
The projector is
A projection means for projecting an image of a predetermined test pattern onto the structure;
The portable terminal is
Photographing means for photographing an image of the structure;
Acquire video data generated using mapping information indicating video distortion in the structure obtained by using video captured by the imaging means when a predetermined test pattern is projected by the projector Acquisition means to
Communication means for transmitting the video data acquired by the acquisition means to the projector ;
Calculation means for calculating the mapping information;
Third transmission means for transmitting the mapping information to a server having generation means for generating video data using the mapping information;
Have
The projection system , wherein the acquisition unit acquires video data generated using the mapping information calculated by the calculation unit from the server . A projector projecting an image of a predetermined test pattern onto the structure;
A photographing means of a portable terminal for photographing an image of the structure;
Obtaining the mapping information indicating the distortion of the image in the structure obtained using the image captured by the imaging means when the mobile terminal is projecting the test pattern;
The portable terminal obtaining video data generated using the mapping information;
The portable terminal transmitting the acquired video data to the projector;
The projector receiving the transmitted video data;
The projector projecting an image indicated by the received image data ;
Said portable terminal, said image taken by the imaging means, have a sending from the video server having a calculating means for calculating the mapping information when the test pattern by the projector is projected ,
A method for controlling a projection system , wherein in the step of acquiring the video data, the portable terminal acquires video data generated using mapping information calculated by the server . A projector projecting an image of a predetermined test pattern onto the structure;
A photographing means of a portable terminal for photographing an image of the structure;
Obtaining the mapping information indicating the distortion of the image in the structure obtained using the image captured by the imaging means when the mobile terminal is projecting the test pattern;
The portable terminal obtaining video data generated using the mapping information;
The portable terminal transmitting the acquired video data to the projector;
The projector receiving the transmitted video data;
The projector projecting an image indicated by the received image data ;
The portable terminal calculating mapping information;
The portable terminal transmitting the mapping information to a server having generating means for generating video data using the mapping information;
Have
A method for controlling a projection system , wherein, in the step of acquiring the video data, the mobile terminal acquires video data generated using the calculated mapping information from the server . To a computer having a photographing means for photographing images,
A step of taking an image of a structure on which an image is projected by a projector;
Acquire video data generated using mapping information indicating video distortion in the structure obtained using video captured by the imaging means when a predetermined test pattern is projected by the projector And steps to
Transmitting the acquired video data to the projector ;
Met program for the video taken by the imaging means, and a step of transmitting from the video server having a calculating means for calculating the mapping information when the test pattern by the projector is projected hand,
A program for acquiring video data generated using mapping information calculated by the server in the step of acquiring the video data . To a computer having a photographing means for photographing images,
A step of taking an image of a structure on which an image is projected by a projector;
Acquire video data generated using mapping information indicating video distortion in the structure obtained using video captured by the imaging means when a predetermined test pattern is projected by the projector And steps to
Transmitting the acquired video data to the projector ;
Calculating map information; and
Transmitting the mapping information to a server having generation means for generating video data using the mapping information ,
In the step of acquiring the video data, a program in which video data generated using the calculated mapping information is acquired from the server .

Images