JP5970879B2 - Projection system, projection method, program, and recording medium - Google Patents

Description

  The present invention relates to a projection system, a projection method, a program, and a recording medium.

  Since the conventional projector needs to be installed at a certain distance from the screen, it is placed near the user and can be directly operated using the keys of the projector main body. Further, when installing the projector, for example, using a projector automatic correction function or a remote controller, the orientation and angle of the projector body are adjusted to correct the projected image (see, for example, Patent Document 1).

  By the way, there is an ultra-short focus projector that can be installed at a position closer to the screen. However, in a projector with an ultra-short focus, since the user is at a position away from the projector main body, there is a problem that the distance to the user is increased and it is difficult to operate. In addition, when the ultra short focus projector is installed on the floor and used, the main body is operated with a particularly crouching posture, so that there is a problem that key operation of the main body is difficult. Further, when the correction is performed by the remote controller as described above, there is a problem that it takes time to install because the number of button operations increases. Note that the present invention is effective not only for an ultra-short focus projector but also for a general projector, when operating away from the projector or when operating on the terminal side.

The present invention has been made in view of the above problems,
An object of the present invention is to provide a projection system, a projection method, a program, and a recording medium that can easily operate a projection image of a projector installed away from a user.

The present invention projects an image including a marker on a projection surface, corrects the projection position of the marker based on correction information received from a terminal device, and an image obtained by capturing an area including the marker on the projection surface. A projection target position, and a terminal device that transmits correction information based on the marker position and the projection target position to the projection device, and the projection device provides a reference marker on the projection surface. A projection unit that projects an image including the communication unit, a communication unit that receives correction information from the terminal device, and a correction unit that corrects the projection position of the marker based on the received correction information. Photographing means for photographing a region including the marker on the projection surface; presentation means for presenting the photographed image; setting means for setting a projection target position on the presented image; and Calculating means for calculating a correction information based on the a location projection target position, the most important feature of having a communication unit for transmitting the correction information to the projection device.

  According to the present invention, it is possible to easily operate the projected image of the projector when away from the user or when it is desired to operate on the terminal side.

1 shows a system configuration of an embodiment of the present invention. It is a figure explaining the process of this invention. It is a figure explaining the correction process of the projection surface by the correction information of this invention. The processing flowchart of the Example of this invention is shown. The image at the time of image | photographing from the diagonal position is shown.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the present invention, a projection device installed at a position distant from the user projects a marker image as a reference. The projected marker image is shot by the shooting device of the terminal close to the user, and the user instructs the setting related to the projection on the terminal. Each of the projection apparatus and the terminal has a communication function, and transmits a photographed marker image and information related to the projection to the projection apparatus as instructed by the user. According to the present invention, the projection setting of the projection apparatus is easily performed from a remote position by the projection apparatus having the communication function and the terminal having the communication function and the photographing function.

  FIG. 1 shows a system configuration of an embodiment of the present invention. In FIG. 1A, 101 is a projection device such as a projector, 102 is a terminal device such as a smartphone or a tablet terminal, and 103 is a user. The projection device 101 and the terminal device 102 are connected by wire or wireless.

  FIG.1 (b) shows the structure of a projection apparatus. The projection device 101 includes a projection unit 201 that projects a reference marker on the projection surface, a projection correction unit 202 that corrects the projection position of the marker based on the projection correction information, a communication unit 203 that communicates with the terminal device 102, and projection. A control unit 204 that controls the apparatus 101 is provided.

  FIG.1 (c) shows the structure of a terminal device. The terminal device 102 includes an image capturing unit 301 such as a camera that captures an image, an image presenting unit 302 such as a display that presents the captured image to the user, an input unit 303 that receives a setting target position setting instruction from the user, and a captured marker. A correction information calculation unit 304 that calculates correction information based on the position and the projection target position, a communication unit 305 that communicates with the projection apparatus 101, and a control unit 306 that controls the terminal apparatus 102.

  The projection apparatus corresponds to a projector that projects and displays the contents of document data on a screen, but the present invention is not limited to this. Projection is not limited to the DLP method (a method in which light is reflected by a DLP chip and projected) or the liquid crystal method (a method in which light is transmitted through the liquid crystal to project a shadow), and is to project an image on a screen or the like Including.

  FIG. 2 is a diagram for explaining the processing of the present invention. Marker projection and camera shooting will be described with reference to FIG. Since the projector 101 is installed near the screen 104 and the user 103 is viewed from a position away from the screen 104, the user 103 is located away from the projector 101.

  The projector 101 projects 106 an image in which markers 105 are displayed at the four corners of the projection surface on the screen 104. The user 103 uses the camera 301 of the smartphone 102 to photograph 107 the projection surface on the screen 104.

  The marker 105 is a characteristic image because it is used for grasping where the point projected by the projector 101 is in the captured image.

  A method for setting the projection target position on the smartphone will be described with reference to FIG. A photographed marker 105 is displayed on the screen 302 of the smartphone 102. On the smartphone 102, software for setting the projection of the projector 101 is operating. The user 103 instructs the projection target position of the projector 101 by touching on the screen of the smartphone 102 with the photographed marker 105 as a reference. The input unit 303 can set the projection target position instructed by the user 103 on the screen 302 as a setting frame (rectangular frame) 108 and set an area that the user 103 wants to project.

  FIG. 3 is a diagram for explaining the projection surface correction processing based on the correction information of the present invention. FIG. 3A shows the relationship between the position of the projection surface and the projection angle. The distance (a ′) between the markers 105 on the image and the distance (b ′) between the markers 105 and the projection target position 110 depend on the angles (a °, b °) of the projection source 109 of the projection unit 201, respectively. Yes. The ratio of the angle (a °, b °) of the projection source 109 is constant regardless of the distance from the screen 104.

Further, the following information is obtained from images taken by the projector 101 and the smartphone 102.
Information known by projector 101: Angle between projected markers Information known from captured image: Coordinates of projected marker 105 and coordinates of projection target position 110 (set frame) As projection target positions, two markers The relative position according to the distance from is used. The position of the projection target can be determined based on two or more pieces of relative position information. Therefore, it is not affected by the size and resolution of the captured image.

  As shown in FIG. 3B, correction information (coordinate information) is generated based on image data captured by the smartphone 102 with the upper left of the image as a reference (0, 0), and the correction information (coordinate information). Is transmitted to the projector 101. Since it is only necessary to know the relative position of each point, it is not always necessary to use the upper left of the image as a reference. As shown in FIG. 3B, the correction information calculation unit 304 calculates the coordinates of the four markers 105 and the coordinates of the projection target position 110 (four corners of the setting frame). Note that the correction information calculation unit 304 may be provided in the projector 101 instead of the smartphone 102.

  As shown in FIG. 3C, the projector 101 calculates the relative distance between the marker 105 and the projection target position 110 based on the correction information (coordinate information), and corrects the projection angle a ° to the projection angle b °. By doing so, the marker position can be corrected. First, with respect to the horizontal axis, the distance between the marker position M3 and the marker position M4 is a1, the distance from the marker position M3 to the setting position 108 of the setting frame is b1, and the position of the marker position M4 is changed by b1 / a1. Let Next, with respect to the vertical axis, the distance between the marker position M1 and the marker position M4 is a2, and the distance between the marker position M2 and the setting position 108 of the setting frame is b2, and is changed by b2 / a2.

  FIG. 4 shows a process flowchart of the embodiment of the present invention. In step 1, the projection device (projector) 101 projects an image of the marker 105 indicating the target of the current projection position.

  In step 2, the imaging unit 301 of the terminal device (smartphone) 102 having a shooting function captures an image including the marker 105 projected on the projection surface.

  In step 3, the image presentation unit 302 having an image display function of the terminal device (smart phone) 102 presents the captured image to the user 103.

  In step 4, the user 103 sets a projection target position by arranging a setting frame 108 indicating a projection target position to be actually projected at a position within the marker 105 displayed on the terminal device (smartphone) 102. Instruct.

  In step 5, the correction information calculation unit 304 of the terminal device (smart phone) 102 calculates correction information (coordinate information) of the position of the captured marker 105 and the position of the setting frame 108 (projection target position) input from the user 103. To do.

  In step 6, the terminal device (smart phone) 102 transmits correction information (coordinate information) to the projection device (projector) 101 using the communication unit 305.

  In step 7, the projection correction unit 202 of the projection apparatus (projector) 101 calculates the relative position of each point based on the correction information (coordinate information) received via the communication unit 203, and determines the projection position of the marker 105. The marker 105 is projected after correction.

  In step 8, the terminal device (smart phone) 102 captures the projected marker 105, and ends the process if the marker 105 is at the projection target position 110. If the marker 105 and the projection target position 110 are separated, the process returns to step 6 in order to cause the projector 101 to perform correction again.

  When photographing the projection surface on the screen described above, when photographing from the front of the screen, the setting is made at a position visible from the front. However, if the image is taken from an oblique angle on the screen, the image to be taken is distorted as shown in FIG. In such a case, if a frame for setting a projection target position (projection area) is arranged on the premise of photographing from the front, the setting is distorted from the front.

  Therefore, as a method of dealing with this, there is a method of manually correcting a trapezoid of a captured image. A function (image correction means) that can operate the smartphone to correct the keystone of the image is used. This function allows the user to create a state where the screen is viewed from the front. By matching the setting frame to this image, it is possible to set a projection area without distortion as seen from the front.

  As described above, in the present invention, it is possible to operate in a simple procedure without generating unnecessary costs by using a terminal device that is close to the user such as a smartphone. In addition, since only one terminal device is required, a plurality of projectors can be set without mounting a camera on the projector. Furthermore, since the projected image is captured and corrected from the terminal device at hand, a projector that can be operated with a simple procedure without cost is realized by not mounting a camera on the projector.

  The present invention may be realized by software using a CPU. That is, the projection device and the terminal device are a CPU that executes instructions of a program that realizes each function of a projection correction unit, a correction information calculation unit, and an input unit, a ROM that stores the program, and a RAM that develops the program And a storage device such as a hard disk for storing the image data described above. In the present invention, a storage medium storing software program codes for realizing the functions of the above-described embodiments is supplied to a projection apparatus and a terminal apparatus, and the CPU of the apparatus reads and executes the program codes stored in the storage medium Is also achieved. In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment. As a storage medium for supplying the program code, for example, a hard disk, an optical disk, a magneto-optical disk, a nonvolatile memory card, a ROM, or the like can be used. Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) operating on the computer based on an instruction of the program code. A case where part or all of the actual processing is performed and the functions of the above-described embodiments are realized by the processing is also included. Further, after the program code read from the storage medium is written into a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function expansion is performed based on the instruction of the program code. A case where the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing is included. Further, the program for realizing the functions and the like of the embodiments of the present invention may be provided from a server by communication via a network.

DESCRIPTION OF SYMBOLS 101 Projection apparatus 102 Terminal device 103 User 201 Projection part 202 Projection correction part 203 Communication part 204 Control part 301 Image pick-up part 302 Image presentation part 303 Input part 304 Correction information calculation part 305 Communication part 306 Control part

JP 2004-274283 A

Claims (6)

A projection device that projects an image including a marker on a projection surface and corrects the projection position of the marker based on correction information received from a terminal device, and a projection target position on an image obtained by imaging an area including the marker on the projection surface set, and a terminal apparatus to be transmitted to the projection device correction information based on the position and the projection target position of the marker,
The projection device is:
Projection means for projecting an image including a marker serving as a reference on the projection surface;
Communication means for receiving correction information from the terminal device;
Correction means for correcting the projection position of the marker based on the received correction information;
Have
The terminal device
Photographing means for photographing an area including the marker on the projection surface;
Presenting means for presenting the captured image;
Setting means for setting a projection target position on the presented image;
Calculation means for calculating correction information based on the position of the marker and the projection target position;
Communication means for transmitting the correction information to the projection device;
Projection system characterized in that it comprises a. The setting means, projection system of claim 1, wherein the setting the projection target position by a touch input.   The projection system according to claim 1, wherein the terminal device includes an image correction unit that performs trapezoidal correction on a captured image from an oblique direction.   A projection method comprising: a projection device that projects an image on a projection surface; and a terminal device that transmits predetermined information to the projection device, wherein the projection means of the projection device serves as a reference marker for the projection surface A step of projecting an image including: a step of photographing an area of the terminal device including a marker on the projection surface; a step of presenting the photographed image by a presentation unit of the terminal device; The setting unit of the terminal device sets a projection target position on the presented image, and the calculation unit of the terminal device calculates correction information based on the position of the marker and the projection target position. A communication unit of the terminal device transmits the correction information to the projection device; a communication unit of the projection device receives correction information from the terminal device; and a correction unit of the projection device. The above Projection method characterized by comprising the step of correcting the projection position of the marker based on the signal correction information. A program for causing a computer to realize the projection method according to claim 4 . A computer-readable recording medium on which a program for causing a computer to realize the projection method according to claim 4 is recorded.