JP2016197192A - Projection system and video projection method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection system that projects a video on a moving screen without using a marker.SOLUTION: A projection system comprises: a screen arrangement device 10 that moves to arrange a screen at a desired position where a user wants to project a video; a camera 20 that photographs an image including the screen; a projector 40 that projects a video on the screen; and a projection control device 30. The projection control device 30 controls the screen arrangement device with information on a projection request position as an input, acquires the image including the screen, and estimates the position of the screen from the image. When the screen is determined to be arranged at the desired position, the projection control device 30 projects a video on the moving screen.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a projection system and an image projection method for projecting an image.

  In recent years, various video projection methods and various types of screens have been developed to project video stereoscopically, and the applicability in art and entertainment has been expanding. However, in many cases, the screen for projecting images is fixed, and its usage has been limited.

  As a video projection method that enables new interaction, for example, a method disclosed in Non-Patent Document 1 is known. The image projection method is a method of projecting an image by attaching a marker to the base of the screen and dynamically detecting the position of the marker.

Yu Ishikawa and five others, “Hanamizu: Fog screen capable of multi-viewpoint observation and movement”, Transactions of the Virtual Reality Society of Japan, Vol.19, No.2, pp.227-236, 2014.

  However, the method of Non-Patent Document 1 requires a marker to be attached in the vicinity of the moving screen, and its use is limited.

  The present invention has been made in view of this problem, and an object of the present invention is to provide a projection system and an image projection method that can project an image on a moving screen without attaching a marker to the screen.

  The projection system of the present invention estimates a position of the screen by recognizing the moving screen, moving the screen to a desired position, and estimating that the screen is at the desired position. A projection control device for projecting a video image.

  The video projection method of the present invention is a video projection method in which a projection system projects an image, the screen arranging step of arranging the screen by moving the screen to a desired position, and the screen recognizing the moving screen. And a projection control step of projecting an image when the screen is estimated to be at the desired position.

  According to the present invention, it is possible to provide a projection system and a video projection method capable of projecting an image on a moving screen without attaching a marker to the screen.

It is a figure which shows the structural example of the projection system 1 of 1st Embodiment. It is a figure which shows the operation | movement flow of the image | video projection method which the projection system 1 performs. It is a figure which shows the other example of arrangement | positioning of a camera. It is a figure which shows the other example of the screen arrangement | positioning apparatus.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The same reference numerals are given to the same components in a plurality of drawings, and the description will not be repeated.

[First Embodiment]
FIG. 1 shows a system configuration example of a projection system 1 including a projection control device 30 according to the first embodiment of the present invention. The projection system 1 includes a screen arrangement device 10, a camera 20, a projection control device 30, and a projector 40.

  The screen arrangement device 10 moves and arranges the screen to a desired position where the user wants to project an image. A desired position where the user wants to project an image is one point or a range on the space of the projection environment 2. The desired position may be input directly to the screen arrangement device 10 or may be input to the projection control device 30. The person 4 in the projection environment 2 is a presenter, for example.

  The screen arrangement device 10 is a device that generates an intangible fog screen (Fog Screen) 3 such as gas or fog in a space. The fog screen 3 can be arranged at an approximate position in a desired direction by, for example, an ultrasonic wave or gas injection device.

  Hereinafter, the description of the present embodiment will be made by taking the fog screen 3 formed of fog or smoke as an example. However, the screen need not be the fog screen 3 as long as it moves.

  The camera 20 captures an image including the fog screen 3 arranged by the screen arrangement device 10. There may be a plurality of cameras 20.

  The projection control device 30 controls the screen arrangement device 10 with the position information of a desired position as an input, acquires an image including the fog screen 3, and estimates the position of the fog screen 3 from the image. Then, when it is estimated that the fog screen 3 is at a desired position, an image is projected onto the fog screen 3 via the projector 40.

  The operation of the projection control device 30 will be described in detail with reference to the operation flow of the video projection method shown in FIG. The projection control device 30 includes a projection position receiving unit 31, a screen control unit 32, an image acquisition unit 33, a projection position estimation unit 34, and a video projection unit 35.

  The image acquisition unit 33 acquires an image of the projection environment 2 on which the fog screen 3 is arranged from the camera 20 (step S1). An image is digital information.

  The projection position receiving unit 31 receives input of position information representing a desired position where the user wants to project an image (step S2). A desired position is received by inputting specific coordinates (range or point) on, for example, a two-dimensional plane of an image captured by the camera 20. The input is performed by a user who uses the projection system 1.

  The screen control unit 32 controls the screen arrangement device 10 to move and arrange the fog screen 3 at the specific coordinates (range or point) (step S3). Step S3 corresponds to a screen placement step performed by the screen placement device 10.

  Since the fog screen 3 is fog, it is difficult to arrange the fog screen 3 in accordance with specific coordinates. The edge of the fog screen 3 is a portion where the fog is thin, and its presence is sparse. Further, the fog screen 3 is affected by the wind of the indoor air conditioning. Therefore, the position of the fog screen 3 moves so as to drift without being fixed.

  The projection position estimation unit 34 estimates the position and time at which the fog screen 3 is closest to the desired position from the movement locus of the fog screen 3 obtained from the image (step S4). The fog screen 3 cannot always be disposed at a desired position due to an obstacle on the projection environment 2. Therefore, the projection position estimation unit 34 estimates the position of the fog screen from the movement of the fog screen 3.

  To detect the fog screen 3 from the image, for example, an object detection technique using the Mean-Shift method (reference: http://cose-stor.sfsu.edu/~kazokada/research/okada cvim08 meanshift.pdf) Can be used. Depending on the object detection technique used, a learning image of an object to be a screen may be required. In that case, for example, the projection position estimation unit 34 learns an image of a temporal change in the shape of the fog screen 3.

  The movement speed and movement direction of the detected (recognized) fog screen 3 are calculated using, for example, an image frame rate (for example, 30 fps). The movement vector of the fog screen 3 is calculated by calculating the difference between the frames of the image of the fog screen 3 (step S4a).

  The projection position estimation unit 34 estimates the movement trajectory of the fog screen 3 from the movement vector, and estimates the time and position where the movement trajectory and the desired position are within the specified range (step S4b).

  The designation range can be designated as a circle within a radius x [m] from a desired position, or only the upper part of the circle. The designated range may be the lower part of the circle having the radius x [m], the right part, or the like. Moreover, the shape of the designated range is not limited to a circle.

  The designated range is received simultaneously when the projection position receiving unit receives desired position information. Note that the designated range may coincide with a desired position (range).

  The projection position estimation unit 34 repeats the processes of steps S4a and S4b until it is estimated that the fog screen 3 exists at a position within a certain range from the desired position, thereby improving the projection position estimation accuracy.

  The video projection unit 35 projects the video via the projector 40 at the estimated position of the time estimated by the projection position estimation unit 34 (step S5). Step S5 corresponds to a projection control step.

  Although the video projection unit 35 and the projector 40 have been described as separate configurations, the video projection unit 35 may include the projector 40. There may be a plurality of projectors 40.

  As described above, the projection system 1 according to the present embodiment estimates the movement trajectory from the movement of the moving fog screen 3, for example, and the movement trajectory and the desired position are within the specified time and position. Video can be projected. That is, an image can be projected on a moving screen without using a marker.

  As described above, the projection system 1 of the present embodiment enables a new effect of projecting an image on a moving screen without using a marker, and realizes a highly flexible interaction. In addition, new information presentation technology can be provided.

  Although the movement vector of the fog screen 3 has been described with a two-dimensional example, the movement vector is not limited to two dimensions. As shown in FIG. 3, the movement vector of the fog screen 3 can be obtained in three dimensions by arranging a camera 21 that captures an image from above the projection environment 2. By using a three-dimensional movement vector, it is possible to provide a projection system that can project an appropriate image even when the fog screen 3 moves in the depth direction of the projection environment 2. The camera 21 may be disposed on the same plane as the camera 20.

  The screen may not be the fog screen 3. Any screen that can be moved. For example, a screen 41 or the like placed on a movable carriage 42 as shown in FIG. 4 may be used. The movement of the carriage 42 is controlled by random numbers, for example, and is programmed to be freely movable within the projection environment 2. The screen 41 is also movable in the vertical direction.

  The projection position estimation unit 34 can also estimate the movement of the screen 41. In addition, when using the screen 41 which does not need to control a movement as mentioned above, the structure of the screen control part 32 does not need to be.

  The video projection unit 35 can also project a video corresponding to the movement. In addition, the projection system 1 according to the present embodiment can project an image even on a screen that does not move, that is, a screen that is fixed at an arbitrary position in the projection environment 2.

  As described above, the present invention is not limited to the above-described embodiment, and various modifications can be made within the scope of the gist thereof.

  When the projection control device 30 is realized by a computer, the processing contents of functions that each device should have are described by a program. Then, by executing this program on the computer, the processing unit in each device is realized on the computer.

  The program is distributed by selling, transferring, or lending a portable recording medium such as a DVD or CD-ROM in which the program is recorded. Further, the program may be distributed by storing the program in a recording device of the server computer and transferring the program from the server computer to another computer via a network.

  Each functional unit may be configured by executing a predetermined program on a computer, or at least a part of these processing contents may be realized by hardware.

1: Projection system 2: Projection environment 3: Fog screen 4: People (presenter)
10: Screen arrangement device 20: Camera 21: Camera 30: Projection control device 40: Projector 41: Screen 42: Cart

Claims (4)

A screen placement device for placing the screen by moving it to a desired position;
A projection system comprising: a projection control device that recognizes the moving screen, estimates a position of the screen, and projects an image when the screen is estimated to be at the desired position. In the projection system according to claim 1,
The screen arrangement device includes:
A projection system characterized by placing fog screens formed of fog or smoke in the space. In the projection system according to claim 1 or 2,
The projection control device includes:
A projection position receiving unit that receives input of position information representing the desired position;
A screen control unit for controlling the screen arrangement device using the position information to move and arrange the screen; and
An image acquisition unit for acquiring an image including the screen;
A projection position estimation unit that estimates the position and time at which the screen is closest to the desired position from the movement trajectory of the screen obtained from the image;
A projection system comprising: an image projection unit that projects the image on the screen that is estimated to exist at a position within a certain range from the desired position. A projection method in which a projection system projects an image,
A screen placement step for placing the screen by moving it to a desired position;
A projection control step of recognizing the moving screen, estimating a position of the screen, and projecting an image when the screen is estimated to be at the desired position.

Images