JPWO2015170680A1 - Projection system - Google Patents

Abstract

In the projection system of the present invention, a projection video (Pi) in which markers (Mr1 to Mr4) are included at predetermined positions of the content video (Cr1 to Cr3) to be projected onto the projection target (En) is the projection target (En). ) And a detection unit (3) for detecting the positions of the feature position (Pp) and the markers (Mr1 to Mr4) corresponding to a predetermined position of the projection target (En). ) And the position of the feature (Pp) and the position of the markers (Mr1 to Mr4), the projection correction unit (2) performs alignment correction of the projection image (Pi) with respect to the projection target (En). And.

Description

  The present invention relates to a projection method for projecting an image on a projection object and a projection system for performing projection.

  In recent years, the use of a projection system that projects a video on a large place such as an outer wall of a building, a shopping mall, or an amphitheater is increasing. In the projection system, an operator manually adjusts the projection position, angle, and the like of the projected image by visual recognition in order to accurately project the projected image on the screen. However, manual adjustment of the projected image may cause a difference depending on the worker, such as the proficiency level and skill of the worker. Further, since the position adjustment is based on the visual observation of the operator, the time required for the position adjustment increases, and the cost (labor cost, place cost) and the like increase.

  Therefore, in Patent Document 1, it is proposed to project a predetermined pattern video, detect the pattern video, and perform corrections such as alignment of the projected video and geometric correction based on the detected pattern video. ing. By using such a correction method, it is possible to accurately project a projected image on a projection surface that is not a flat surface such as a dome screen.

  Further, Patent Document 2 discloses a projection system that projects visible and invisible images on one screen, a detector that detects an invisible image projected on the screen, and a visible image based on the invisible image detected by the detector. A calibration device has been proposed comprising a calibration control device for calibrating the projection of the image. In this calibration device, an invisible image is detected by the detector, and the projection of the hanging image is calibrated by the calibration control device based on the detection result. Therefore, it is possible to adjust the projection of the visible image with high accuracy without taking the projection system offline (that is, without stopping the projection of the visible image). For example, even when the angle of a projection device that projects a visible image such as a projector is shifted or moved, the position and angle of the projected image can be adjusted without stopping the projection of the visible image. Can do.

International Publication No. 2006/025191 JP 2011-2111693 A

  However, in the case of the configuration of Patent Document 1, the projection of the pattern image on the projection surface and the detection of the pattern image are performed, and then the projection image is corrected. However, it takes time to correct the projected image.

  Further, in the case of the configuration of Patent Document 2, in order to detect an invisible image that is projected simultaneously with the visible image and perform correction based on the invisible image, the hanging image is not stopped without stopping the projection of the visible image. Adjustments can be made. However, it is difficult to superimpose (paste) the visible image on a predetermined position of the projection target, and it is difficult to project the visible image while checking the detection result of the invisible image.

  SUMMARY OF THE INVENTION Accordingly, an object of the present invention is to provide a projection system that automatically superimposes on a projection object and projects a projection image.

  In order to achieve the above object, the present invention provides a projection unit that projects a projection image in which a marker is included in a portion corresponding to a predetermined position of a content image to be projected onto the projection target, and the projection target. A feature position corresponding to the predetermined position of the body, a detection unit for detecting the marker position, and the projection so that the feature position and the marker position are in a predetermined positional relationship. A projection correction unit that performs alignment correction of the image with respect to the projection target.

  According to this configuration, the marker included in the projection image and the feature position of the projection target are detected, and projection correction is performed so that the marker and the feature position are overlapped. Thereby, when aligning a projection image | video with a to-be-projected body, it is possible to align the said projection image | video and the said to-be-projected object correctly irrespective of an operator's visual observation.

  As a result, the accuracy of alignment of the projected image with the projection target can be always projected with stable accuracy regardless of the skill level and ability of the operator. In addition, it is possible to perform instantaneous alignment by performing image processing at high speed.

  In the above configuration, an image generation unit that generates the projection video by adding the marker to the content video, and the image generation unit determines the number of markers and the position of the marker based on the content video. It may be determined.

  In the above configuration, the image generation unit may perform image processing, and the image generation unit may include a content video that has been subjected to image processing in accordance with the alignment correction.

  In the above configuration, the image generation unit may use a shape capable of detecting a rotation angle as at least one of the markers. At this time, the angle of the projection image may be acquired from the shape of the marker detected by the detection unit.

  The said structure WHEREIN: The said projection part can project at least one part of the said marker with invisible light, and the said detection part may also be able to detect the position of the marker projected with the said invisible light. In this configuration, the projection unit may be able to project at least a part of the projection light of the marker by switching between visible light and invisible light.

  The said structure WHEREIN: You may provide two or more said projection parts so that a projection image | video can be projected on the said to-be-projected body from several different positions.

  In the above configuration, the projected images projected from the different positions may include different markers.

  The said structure WHEREIN: The said detection part may be provided with the outline detection part which detects the outline of the said to-be-projected body. Furthermore, the image generation unit may generate a projection video corresponding to the contour of the projection target.

  The said structure WHEREIN: The said projection part and the said detection part may be arrange | positioned in the position which makes a fixed angle centering | focusing on the said to-be-projected body.

  In the above configuration, the detection unit may detect the movement speed of the projection object, and the projection correction unit may greatly correct the feature position when the movement speed of the projection object increases. The projected image may be blurred according to the moving speed.

  The said structure WHEREIN: You may provide the position detection part which detects the relative position of the said detection part and the said projection part.

  The said structure WHEREIN: The said detection part may be provided with the characteristic position detection part which detects the said characteristic position of the said to-be-projected object, and the marker detection part which detects the position of the said marker image | video. The position detection unit may detect a relative position between the marker detection unit and the projection unit.

  The said structure WHEREIN: The structure which projects a projection image | video by making into a said to-be-projected body the moving body which moves, changes, etc. according to time may be sufficient.

  ADVANTAGE OF THE INVENTION According to this invention, the projection system which projects a projection image | video on a to-be-projected object correctly correctly can be provided.

It is the schematic which shows the projection state of the projection image | video using an example of the projection system concerning this invention. It is a block diagram of an example of the projection system concerning the present invention. It is a schematic perspective view of an optical axis shift part. It is a figure which shows having detected the characteristic position of the to-be-projected body. It is the figure which showed typically mixing of a content image | video and a marker image | video. It is a flowchart which shows the procedure which performs the projection correction | amendment with respect to the to-be-projected body of a projection image. It is a schematic diagram which shows the detection of a marker position. It is a schematic diagram which shows alignment with a marker and a characteristic position. It is a schematic diagram which shows position alignment with the to-be-projected body of a projection image. It is a figure which shows a marker and feature position when performing projection correction with the projection system concerning this invention. It is a figure which shows the state which performed the projection correction by the marker and characteristic position which are shown in FIG. It is a figure which shows projection correction | amendment when performing projection with the projection system concerning this invention. It is a figure which shows the shape of the marker used with the projection system concerning this invention. It is a figure which shows the detected marker. It is a block diagram of the other example of the projection system concerning this invention. It is a figure of the state which projected the projection image on the to-be-projected body of the state which put on the hat. It is a figure of the state which projected the projection image on the to-be-projected body of the state which lifted the hat. It is a figure of the state which projected the projection image on the to-be-projected body of the state which skipped the hat. It is a figure which shows the characteristic position of the state which put on the hat. It is a figure which shows the characteristic position of the state which lifted the hat. It is a figure which shows the characteristic position of the state which skipped the hat. It is a block diagram of the further another example of the projection system concerning this invention. It is a figure of the characteristic position of a to-be-projected body when a moving speed changes. It is a block diagram which shows the further another example of the projection system concerning this invention. It is a block diagram of the further another example of the projection system concerning this invention. It is a block diagram of the further another example of the projection system concerning this invention. FIG. 22 shows a characteristic position of the projection object detected by the projection system shown in FIG. 21. FIG. 22 shows an outline of a projection object detected by the projection system shown in FIG. 21. It is a top view which shows arrangement | positioning of the projection part and detection part of the projection system concerning this invention. It is a block diagram of the further another example of the projection system concerning this invention. It is a figure which each shows the detected marker and the characteristic position. It is a block diagram of the further another example of the projection system concerning this invention.

A projection system according to the present invention will be described with reference to the drawings.
(First embodiment)

  FIG. 1 is a schematic diagram showing a projection state of a projected image using an example of a projection system according to the present invention. As shown in FIG. 1, the projection system A projects a projection image Pi from the projection unit 1 onto a projection target (here, the performer En). In the projection shown in FIG. 1, an image is projected on the clothes worn by the performer En to change the clothes. As shown in FIG. 1, an image of the color Cr1 is projected on both arms (both sleeves) of the performer En, an image of the color Cr2 is projected on the torso portion, and an image of the color Cr3 is projected on both feet (trousers). Projected. Note that FIG. 1 illustrates an example in which one color is projected on each part, but in reality, it is possible to project an image of the shape of clothes such as a pattern, a button, a collar, and a tie. .

  As shown in FIG. 1, a projection system A according to the present invention projects a projection image Pi from a projection unit 1, a detection unit 3 detects a projection object (actor En) and a projection image Pi, and a projection object ( The shift between the performer En) and the projected image Pi is corrected.

  In the projection system A according to the present invention, the projection image Pi includes a plurality of markers Mr indicating the overlapping positions with the characteristic positions (details will be described later) indicating the characteristics of the object to be projected (actor En) (see FIG. 1). In the projection system A, the projection image Pi is projected onto the projection object (performer En), and a plurality of markers Mr are superimposed on the characteristic positions of the projection target object (performer En). En) is accurately aligned and projected.

  The projection video Pi is generated by combining a content video Cp, which is a video to be projected (pasted) on the surface of the projection target (actor En), and a marker video Mp including videos of a plurality of markers Mr. The content video Cp and the marker video Mp are respectively stored in the storage unit 5, and the image generation unit 4 combines the content video Cp and the marker video Mp to generate a projection video Pi. The projection video Pi may be supplied in advance. Details of the projection system A according to the present invention will be described below with reference to the drawings.

  FIG. 2 is a block diagram of an example of a projection system according to the present invention. As shown in FIG. 2, the projection system A includes a projection unit 1, a projection correction unit 2, a detection unit 3, an image generation unit 4, a storage unit 5, an operation unit 6, and a processing unit 7. In the block diagram shown in FIG. 2, solid arrows indicate transmission / reception of signals, thick dashed arrows indicate transmission / reception of video data, and white arrows indicate driving.

  As the projection unit 1, for example, a so-called projector can be cited, but the projection unit 1 is not limited to this. The projection unit 1 projects visible light and projects a projected image Pi of visible light onto a projection target (actor En). The projection unit 1 is connected to the image generation unit 4 and the processing unit 7, and projects the projection video Pi supplied from the image generation unit 4 onto the surface of the projection target (actor En), thereby expressing the video (projection mapping). I do. The projection unit 1 starts / stops projection and adjusts the luminance of the projection image Pi in accordance with an instruction from the processing unit 7.

  When projection mapping is performed using the projection system A, what kind of image is projected on what kind of projection object (actor En) is determined in advance from the start to the end of projection mapping. In the projection mapping, the projection image Pi may be shifted depending on the relative position and relative angle between the projection target (actor En) and the projection unit 1, and usually the projection target (before the actual projection mapping is performed) Accurate alignment of the projected image Pi is performed with respect to the performer En).

  The storage unit 5 is connected to the image generation unit 4 and the processing unit 7. The storage unit 5 includes a semiconductor memory such as a ROM, a RAM, and a flash memory, and a physical storage device such as a hard disk and an optical disk. The storage unit 5 includes a content video storage unit 51 that stores the content video Cp, and a marker video storage unit 52 that stores the marker video Mp.

  The image generation unit 4 generates a projection video Pi that is a combination of the content video Cp provided from the storage unit 5 and the marker video Mp. The image generation unit 4 also performs image processing such as changing the generated projected video Pi or changing the color balance as necessary (in accordance with an instruction from the processing unit 7).

  The content video Cp is prepared for each projection mapping content (expression content). In the projection mapping, when the projection video Pi is projected onto the projection target (actor En), if the accuracy of the alignment of the projection video Pi is poor due to the content of the content video Cp to be pasted, the part of the projection target (performer En), etc. There are a part where the quality of the expression is lowered and a part which does not affect the quality of the expression even if the accuracy is somewhat low. Therefore, the marker Mr is set in a portion of the content video Cp where it is not preferable that the alignment accuracy is deteriorated when pasted to the projection target (actor En). That is, the number and position of the markers Mr are determined based on the characteristics such as the content and shape of the content video Cp.

  For example, when the projection image Pi is projected onto the surface of the projection object (actor En) with both hands raised as in the present embodiment, if the projection image Pi to be projected onto a fine part such as a hand or a foot is displaced, the displacement is caused. Easy to stand out. On the other hand, even if the projected image Pi projected on the shoulder, waist, or the like is slightly shifted, the shift is not noticeable. In this way, the alignment accuracy varies depending on the portion where the content video Cp is pasted. Further, when the content video Cp projects a pattern or a figure, it stands out if they are shifted. Therefore, in the present embodiment, the right hand tip Mr1, the face Mr2, the torso central portion Mr3, and the left foot tip Mr4 are set as the markers Mr. Note that the marker Mr is not limited to this, and may simply be a portion that becomes an end of the projection target. What is necessary is just to make the projection image Pi into the position for aligning with a to-be-projected body (performer En) with high precision.

  The marker video Mp is a video corresponding to the content video Cp. When different content videos Cp are pasted on the same projection object (actor En), the marker Mr may be set at the same position. In such a case, it is possible to generate the projection video Pi using the common marker video Mp. As described above, by combining the plurality of content videos Cp with the common marker video Mp, it is possible to save labor for generating the marker video Mp and reduce the storage capacity.

  When projection mapping is performed by the projection system A, the projection video Pi is pasted on the projection target (actor En) in advance before the actual projection, and alignment is performed. At this time, in the case where the projection object is easily movable such as a performer or a vehicle on the stage, the position of the projection unit 1 is roughly determined, and then the alignment is performed by moving the projection object according to the projection image. Is possible.

  On the other hand, when projecting a projection image onto a projection object that cannot move, such as a building, it is difficult to move the projection object. Further, even if the projection object is movable, if the projection object and / or the projection unit once positioned are moved, alignment is necessary again. In such a case, if the optical axis of the projected image of the projection unit 1 is fixed, it takes time to make adjustments.

  Therefore, in the projection system A, the projection correction unit 2 is used to change (shift) the optical axis of the projection image Pi of the projection unit 1 so that the projection image Pi is accurately aligned with the projection target (actor En). . Next, the projection correction unit 2 will be described.

  The projection correction unit 2 includes an optical axis shift unit 21 that physically shifts the optical axis of the image projected from the projection unit 1, and a lens unit 22 that includes a plurality of lenses that project the projection image Pi from the projection unit 1. And. The projection correction unit 2 also includes a controller 23 that controls driving of the optical axis shift unit 21 and the lens unit 22.

  The optical axis shift unit 21 has a configuration for correcting the optical axis of the projection unit 1 by moving the projection unit 1 or changing the angle. The optical axis shift unit 21 is, for example, a two-axis rotary pan head or mirror that swings the projection unit 1 about two axes orthogonal to each other of a horizontal axis and a vertical axis and shifts the optical axis from the projection unit 1. May be used to shift the optical axis of the projected image Pi, and the optical axis can be translated in the horizontal direction and / or the vertical direction, but is not limited thereto. Here, a biaxial rotating head is used.

  FIG. 3 is a schematic perspective view of the optical axis shift unit. As shown in FIG. 3, the optical axis shift unit 21 is a biaxial rotating pan head that supports the projection unit 1 so as to be rotatable about the vertical axis C1 and the horizontal axis C2. The optical axis shift unit 21 includes an actuator (not shown) that rotates the projection unit 1 around a horizontal axis and / or a vertical axis. By driving the actuator, the projection unit 1 can be rotated about the vertical axis C1 and / or the horizontal axis C2, and the optical axis of the projection image Pi can be swung around the projection unit 1.

  As shown in FIG. 3, the lens unit 22 is attached to an emission unit from which the projection image Pi of the projection unit 1 is emitted. The lens unit 22 enlarges or reduces the projected image Pi projected on the projection target (actor En) by changing the distances of the plurality of lenses. The controller 23 includes a drive circuit that drives the optical axis shift unit 21 and the lens unit 22. The controller 23 drives the optical axis shift unit 21 to change (shift) the optical axis based on an instruction from the processing unit 7 to change the projection position of the projection image Pi. Further, the controller 23 drives the lens unit 22 based on an instruction to enlarge or reduce the projection video Pi from the processing unit 7.

  In the projection system A, the lens unit 22 constitutes the projection correction unit 2. However, the projection unit A is not limited to this, and may be provided in the projection unit 1. In this case, the controller 23 of the projection correction unit 2 may be able to drive the lens unit 22. Further, an instruction to shift the optical axis from the processing unit 7 may be sent to the projection correction unit 2, and an instruction to enlarge or reduce the projection image Pi may be sent to the projection unit 1.

  In the projection system A, alignment is performed by superimposing the feature position of the projection target (actor En) and the marker Mr in the projection image Pi. Therefore, in the projection system A, the detection unit 3 detects the position of the marker Mr and the feature position of the projection target (actor En). The detection unit 3 will be described.

  The detection unit 3 includes a marker detection unit 31 that detects the position of the marker Mr, and a feature position detection unit 32 that detects the feature position of the projection target (actor En). The marker detection unit 31 is a detection device for detecting the position of the marker Mr included in the projection image Pi. As described above, the projection video Pi projected by the projection unit 1 combines (synthesizes) the video of the marker Mr with the content video Cp to be pasted on the projection target (actor En). The marker detection unit 31 once captures the projected video Pi, and detects the position of the marker Mr by performing image processing on the captured video.

  In addition, since it is the structure which correct | amends the projection position etc. of the projection image | video Pi of the projection part 1 using the result detected by the detection part 3, relative of the projection part 1, the detection part 3, and a to-be-projected body (actor En). The position is accurately measured in advance, and the position information is stored in the storage unit 5. The position information can be used by the processing unit 7 as necessary (for example, when calculating the correction angle of the projection unit 1).

  The marker detection unit 31 is a detector that detects the position of the marker Mr included in the projection video Pi projected on the projection target (actor En). The marker detection unit 31 detects the position of the marker Mr by performing image processing. For example, the marker Mr can be identified from the shape, color, etc. of the marker Mr, but is not limited thereto.

  The feature position detection unit 32 includes a sensor that detects a feature position of the projection target (actor En). The characteristic position of the projection target (performer En) is a point that characterizes the appearance of the projection target (performer En), such as the shape, distance, and angle, and corresponds to the position of the marker Mr. Here, the feature position detection unit 32 detects infrared rays reflected from the surface of the projection target (actor En), acquires information on the outer shape, distance, and angle, and detects the feature position from the information.

  The feature position detection unit 32 may include a temperature sensor, a distance measurement sensor, a light detection sensor, a voice microphone, or the like, or may include a plurality of the above sensors (detection units). Furthermore, an existing sensor such as Kinect (registered trademark) can be used as the feature position detection unit 32. The feature position detection unit 32 can widely employ a detection device having a configuration capable of accurately measuring the shape, position, angle, and the like of the projection target (actor En).

  The marker detection unit 31 transmits information on the position of the detected marker Mr to the processing unit 7. In addition, the feature position detection unit 32 is configured to transmit information on the detected feature position to the processing unit 7.

  The marker detection unit 31 and the feature position detection unit 32 are independent of the processing unit 7, but when it is necessary to perform some arithmetic processing, the arithmetic processing unit is used using the processing unit 7 using a program or the like. It may be configured to perform arithmetic processing, or the arithmetic processing unit may be included in a part of the circuit of the processing unit 7. The projection system A according to the present invention has a configuration in which the feature position detection unit 2 detects the position and shape of the projection target (actor En) and detects the feature position of the projection target (actor En).

  The operation unit 6 is an external interface for an operator to operate the projection system A. Examples of the operation unit 6 include an operation panel including a physical switch, a touch panel, and a remote controller. Alternatively, an external information device such as a PC or a mobile terminal (tablet, smartphone, etc.) may be connected, and the external information device itself or its input device may be used as the operation unit 6. The operation unit 6 is connected to the processing unit 7 and transmits an operation signal to the processing unit 7.

  The processing unit 7 is a processing circuit that performs arithmetic processing of various data used in the projection system A and controls the projection system A. The processing unit 7 is a circuit including an arithmetic processing unit such as an MPU or CPU, and has a configuration capable of performing a plurality of processes. Moreover, you may have the structure which performs a process by operating a processing program as needed.

  The processing unit 7 includes the projection unit 1, the projection correction unit 2 (the controller 23), the detection unit 3 (marker detection unit 31, feature position detection unit 32), the image generation unit 4, the storage unit 5, and the operation unit 6 described above. Are connected so that signals can be sent and received. For example, when the processing unit 7 receives an operation signal from the operation unit 6, each of the projection unit 1, the projection correction unit 2, the detection unit 3, the image generation unit 4, and the storage unit 5 based on the content of the received operation signal. An instruction signal for performing an operation corresponding to is transmitted. Details of the processing operation of the processing unit 7 will be described later as necessary.

  Next, feature position detection will be described with reference to the drawings. FIG. 4 is a diagram illustrating that the feature position of the projection target is detected. In the projection mapping, the shape, position, angle, and the like of the projection target (actor En) that projects the projection video Pi (the content video Cp is pasted) are determined in advance. The marker video storage unit 52 also includes information on the characteristic position of the projection target (actor En) on which the markers Mr are superimposed. The feature position information provided in the marker video storage unit 52 includes a reference image Sp of the projection target (actor En) and a mark Mk indicating the feature position of the reference shape, as shown in FIG. Yes.

  The feature position detection unit 32 acquires the outline image Fp (outline information) of the projection target (actor En), and the outline image Fp, the reference image Sp and the mark Mk stored in the marker video storage unit 52, and And the position of the feature position Pp in the outer shape image Fp is detected.

  For example, it is assumed that the projected image Pi is projected onto a projection object (actor En) that raises both hands in a standing position. The feature position detection unit 32 calls from the marker video storage unit 52 the reference image Sp in which the projection target (actor En) stands up and the mark Mk indicating the feature position in the reference image Sp. Here, the mark Mk indicates the characteristic position for positioning the projection image. (Here, right hand tip Mk1, face Mk2, torso center Mk3, and left foot tip Mk4).

  And the characteristic position detection part 3 acquires the external shape image of a to-be-projected body (performer En). The feature position detection unit 3 is based on the reference image Sp of the projection object (actor En) and the position information of the mark Mk (Mk1, Mk2, Mk3, Mk4) in the storage unit 5, and the feature position in the acquired outline image Fp. Pp is detected. In the present embodiment, the characteristic positions of the right hand tip Pp1, the face Pp2, the torso central portion Pp3, and the left foot tip Pp4 of the projection object (actor En) that raises both hands are detected.

  In the detection of the characteristic positions Pp1 to Pp4 shown in FIG. 4, the reference image Sp and the marks Mk1 to Mk4 shown in the reference image Sp are shown as information of each marker Mr. In actual detection, it may be detected by comparing with the reference image Sp as described above, or the feature position may be detected from the outline image Fp based on the information of each marker Mr. Further, in FIG. 4, for convenience of explanation, each feature position of the outline image Fp is marked with a circle, but this mark is not always necessary. For example, when the feature position can be accurately detected from the acquired outline image Fp of the projection object (actor En), it is not necessary to set a circular mark. Alternatively, the outline image Fp may be omitted, and only the circular mark information may be acquired. In the above-described embodiment, the feature position Pp is determined based on the information of the marker Mr. However, the feature position may be determined in advance.

  Next, the projection image Pi will be described. FIG. 5 is a diagram schematically showing mixing of content video and marker video. The content video Cp and the marker video Mp are sent from the storage unit 5 to the image generation unit 4. The image generation unit 4 combines the content video Cp and the marker video Mp, and generates a projection video Pi in which the marker Mr is included in the content video Cp. In the projection video Pi shown in FIG. 5, for convenience, the marker Mr is displayed in a large and conspicuous manner. However, in actuality, the marker Mr is difficult to be seen by a viewer viewing the projection object (actor En). What is necessary is just to be able to detect the detection part 31 reliably. By making the marker Mr small and inconspicuous from the viewer, it is possible to enhance the effect of projection mapping video expression.

  Next, a procedure for projecting the projection image Pi onto the projection target (actor En) by the projection system A according to the present invention will be described with reference to the drawings. FIG. 6 is a flowchart showing a procedure for performing projection correction on a projection object of a projected image, FIG. 7 is a schematic diagram showing detection of a marker position, and FIG. 8 is a schematic diagram showing alignment between a marker and a feature position. FIG. 9 is a schematic diagram showing the alignment of the projected video to the projection target.

  In the projection system A, the projection image Pi is once projected onto the projection target (actor En), and then the projection video Pi is accurately aligned with the projection target (actor En). First, the content video Cp from the content video storage unit 51 of the storage unit 5 and the marker video Mp from the marker video storage unit 52 are respectively sent to the image generation unit 4, and the content video Cp and the marker video Mp are combined in the image generation unit 4. A (synthesized) projection image Pi is generated (step S101, see FIG. 5).

  When the projection video Pi is transmitted from the image generation unit 4 to the projection unit 1, the processing unit 7 drives the projection unit 1 to project the projection video Pi onto the projection target (actor En) (step S102, (See FIG. 1). Note that FIG. 1 is a diagram in a state where the alignment is completed, but there is a case where the projection image Pi and the projection target (actor En) are misaligned.

  The processing unit 7 sends an instruction to the detection unit 3, and the feature position detection unit 32 acquires the outline image Fp of the projection target (actor En), and detects the feature positions Pp1 to Pp4 in the outline image Fp (step S103). . In addition, the processing unit 7 sends an instruction to the detection unit 3 to detect the position of the marker Mr of the projected video Pi projected by the marker detection unit 31 (step S104).

  The position of the marker Mr is detected by photographing the projection video Pi projected on the projection target (actor En) by the marker detection unit 31 and performing image processing to detect the marker Mr from the captured video Pi (see FIG. 7). ). Then, the position of the marker Mr is detected. Here, the magnification of the outline image Fp acquired by the feature position detection unit 32 and the magnification of the projected video Pi photographed by the marker detection unit 31 are set to be the same. In this embodiment, the feature position is detected before the marker position is detected, but either may be detected first or may be performed simultaneously.

  Information on the positions of the markers Mr <b> 1 to Mr <b> 4 detected by the marker detection unit 31 and the feature positions Pp <b> 1 to Pp <b> 4 detected by the feature position detection unit 32 is transmitted to the processing unit 7. The processing unit 7 determines whether or not the positions of the markers Mr1 to Mr4 overlap with the feature positions Pp1 to Pp4 (step S105). When the markers Mr1 to Mr4 overlap with the feature positions Pp1 to Pp4 (Yes in step S105), the projection image Pi is accurately superimposed on the projection target (actor En) (see FIG. 1).

  Then, the processing unit 7 determines whether or not to end the projection mapping (step S106). When the projection mapping is finished (Yes in step S106), the alignment process is finished. When the projection mapping is continued (No in step S106), the process returns to the generation of the next projection video Pi (returns to step S101).

  When the markers Mr1 to Mr4 do not overlap with the feature positions Pp1 to Pp4 (No in step S105), the processing unit 7 instructs the projection correction unit 2 to perform projection correction so that the markers Mr1 to Mr4 overlap with the feature positions Pp1 to Pp4. Send. The projection correction unit 2 corrects the projection position for changing the optical axis of the projection image Pi of the projection unit 1 in accordance with the correction instruction (see step S107, FIG. 8, and FIG. 9). After the projection position of the projection correction unit 2 is corrected, the process returns to the feature position detection (returning to step S103), and it is confirmed whether the projection image Pi is accurately aligned with the projection target (actor En).

  The markers Mr1 to Mr4 are easily overlapped with the feature positions Pp1 to Pp4 by setting the coordinate system of the positions of the markers Mr1 to Mr4 and the coordinate system when the feature positions Pp1 to Pp4 are detected as the same coordinate system. Can be combined. Further, in FIG. 8, the markers Mr1 to Mr4 and the characteristic positions Pp1 to Pp4 are displayed apart from each other for easy explanation, but there are many cases where they are slightly shifted in practice. Even in such a case, the position of the projection image Pi can be accurately aligned (projection correction) with the projection target (actor En) by correcting the position by the same method.

  As described above, the projection images Pi are provided with the markers Mr1 to Mr4, and the projection correction unit 2 is used to perform projection correction so that the markers Mr1 to Mr4 are superimposed on the projection target (actor En). And accurate alignment can be performed.

  Further, for example, when projecting the image Pi on the surface of the projection target (actor En), the distance between the projection unit 1 and the projection target (actor En) (the distance between the detection unit 2 and the performer En) is determined first. It may be different from the distance. In this case, the projection image Pi cannot be directly projected onto the projection target (actor En). FIG. 10 is a diagram showing markers and feature positions when performing projection correction in the projection system according to the present invention, and FIG. 11 is a diagram showing a state in which projection correction is performed with the markers and feature positions shown in FIG. . FIG. 10 shows an outline image Fp and feature positions Pp1 to Pp4 of the projection object (actor En) acquired by the feature position detector 32, and markers Mr1 to Mr4 detected by the marker detector 31. FIG. 11 is a schematic diagram showing the alignment of the projected video to the projection target.

  Therefore, the processing unit 7 compares the arrangement of the plurality of markers Mr1 to Mr4 detected by the marker detection unit 31 with the arrangement of the characteristic positions Pp1 to Pp4 of the projection object (actor En) detected by the characteristic position detection unit 32. To do. If the arrangement of the markers Mr1 to Mr4 and the arrangement of the feature positions Pp1 to Pp4 are the same or substantially the same, the processing unit 7 corrects the projection position by changing the projection angle of the projection image. On the other hand, when the arrangement of the markers Mr1 to Mr4 and the arrangement of the characteristic positions Pp1 to Pp4 do not match, the processing unit 7 determines that the distance between the projection target (actor En) and the projection unit 1 is different from the set distance.

  For example, as shown in FIG. 10, when the interval between the characteristic positions Pp1 to Pp4 is wider than the interval between the markers Mr1 to Mr4, the size of the projection image Pi is smaller than that of the projection object (actor En). Cannot align with (actor En). The processing unit 7 determines that the distance of the projection target (actor En) from the projection unit 1 is shorter than the set distance, and enlarges and projects the projection image Pi to the controller 23 of the projection correction unit 2. Sends an instruction to drive the lens unit 22.

  By driving the lens unit 22, the projection image Pi is enlarged and projected onto the projection object (actor En), thereby accurately aligning the projection image Pi with the projection object (actor En). Can do. (See FIG. 11).

  Note that when the projection image Pi is enlarged or reduced by the lens unit 22 and projected onto the projection target (actor En), the size of the markers Mr1 to Mr4 is also enlarged or reduced. The processing unit 7 can check the size of the markers Mr1 to Mr4 detected by the marker detection unit 31, and can confirm whether the markers are enlarged or reduced at a ratio as instructed. Thereby, the projection image Pi can be accurately projected onto the projection target (actor En).

  As described above, in the projection system A according to the present invention, even if the position of the projection object (performer En) is shifted, the projection video Pi is accurately transferred to the projection target (actor En) that is the projection target. It is possible to align automatically. In addition, since the markers Mr1 to Mr4 and the feature positions Pp1 to Pp4 are simply adjusted so as to overlap each other, it is possible to reduce the number of times of visual inspection by the operator and reduce the time and number required for the alignment. Further, even if the projection target is a moving object, the image position can be corrected in real time, so that it is possible to project an image corresponding to the movement.

  In the present embodiment, alignment (correction) to the projection target (actor En) by shifting the optical axis of the projection video Pi using the optical axis shift unit 21 and projection video using the lens unit 22 are performed. Although alignment (correction) using enlargement / reduction of Pi is described separately, both alignment (correction) is performed. In this way, by aligning both, the projected image Pi can be accurately aligned with the projection target (actor En). Moreover, the structure which performs any one correction | amendment may be sufficient.

  In the present embodiment, the detection unit 3 including the marker detection unit 31 and the characteristic position detection unit 32 is described, but the present invention is not limited to this. The marker detection unit 31 and the feature position detection unit 32 may be separate. Further, the detection unit 3 may be formed close to or integrally with the projection unit 1.

  Further, the position correction unit 2 is used to correct the projection position of the projection image Pi so that the position of the marker Mr detected by the marker detection unit 31 during the projection and the feature position detected by the feature position detection unit overlap. Thus, it is possible to align (correct) the projection image Pi with the projection object (actor En) at any time during the actual projection. Thereby, even when the relative positions of the projection unit 1, the detection unit 3, and the projection target (actor En) are shifted during the actual projection, the shift is automatically corrected, and the projection video Pi is accurately corrected. It is possible to project accurately on (actor En).

  Further, since the projection system A itself performs projection correction for aligning the projection image Pi with the projection target (actor En), the operator's visual inspection is unnecessary or the number of times can be reduced. Since the projection system A performs the alignment of the projection image Pi to the projection object (actor En), the alignment accuracy is less affected by the skill level and ability of the operator, and always projects with stable accuracy. It is possible. Moreover, since the number of times of visual inspection by the worker is reduced, the time and the number of workers can be reduced. In addition to superimposing the feature position Pp and the marker Mr, for example, the projection image Pi can be projected by setting the marker Mr to a predetermined positional relationship, for example, by positioning the position of the marker Mr 5 cm to the right of the feature position Pp. You may make it align with (actor En).

(Second Embodiment)
Another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 12 is a diagram showing projection correction when projection is performed by the projection system according to the present invention. In the present embodiment, the projection system A has the same configuration as the projection system of the first embodiment, and will be described using the reference numerals attached to the projection system A.

  FIG. 12 shows the characteristic positions Pp1 to Pp4 of the projection object (actor En) acquired by the characteristic position detection unit 32 and the markers Mr1 to Mr4 detected by the marker detection unit 31. For example, when the projection image Pi is projected on the surface of the projection target (performer En), the front angle of the projection target (performer En) with respect to the projection unit 1 may deviate from a predetermined angle. In this case, the projected image Pi cannot be projected onto the projection target (actor En) by shifting or enlarging or reducing the optical axis.

  Therefore, the processing unit 7 compares the arrangement of the plurality of markers Mr1 to Mr4 detected by the marker detection unit 31 with the arrangement of the characteristic positions Pp1 to Pp4 of the projection object (actor En) detected by the characteristic position detection unit 32. To do. If the arrangement of the markers Mr1 to Mr4 and the arrangement of the feature positions Pp1 to Pp4 are the same or substantially the same, the processing unit 7 corrects the projection position by changing the projection angle of the projection image. On the other hand, when the arrangement of the markers Mr1 to Mr4 does not match the arrangement of the feature positions Pp1 to Pp4, the processing unit 7 determines that the front angle of the projection target (actor En) is shifted. At this time, in addition to the change of the projection angle of the projection unit 1, the processing unit 7 causes the image generation unit 4 so that the arrangement of the markers Mr1 to Mr4 matches or substantially matches the arrangement of the feature positions Pp1 to Pp4. An instruction to perform deformation (image processing) of the projection image Pi is issued.

  For example, as shown in FIG. 12, when the horizontal width of the arrangement of the feature positions Pp1 to Pp4 is narrower than the horizontal width of the arrangement of the markers Mr1 to Mr4, the processing unit 7 compresses the projection image Pi in the width direction. An instruction for such correction is sent to the image generation unit 4.

  In the projection system A of the present embodiment, the projection corrector 2 not only changes the optical axis and size of the projection image Pi, but also deforms the projection image Pi itself, so that the performer En who is the projection target can accurately The projected image Pi can be aligned. That is, in the projection system A of the present embodiment, both physical correction such as optical axis shift and enlargement / reduction of the projected image and electronic correction for changing the image itself are used.

  In some cases, the distance between the projection unit 1 and the projection target (actor En) varies. In this case, the lengths in the vertical direction of the arrangement of the markers Mr1 to Mr4 and the arrangement of the characteristic positions Pp1 to Pp4 do not match. In this case, the change of the magnification of the projected video Pi by the lens unit 22 and the image processing by the image generation unit 4 may be combined. Alternatively, it may be performed only by image processing.

  The processing unit 7 can confirm the shapes and / or sizes of the markers Mr1 to Mr4 detected by the marker detection unit 31, and can confirm whether the projection image Pi is projected as instructed. Thereby, the projection image Pi can be accurately projected onto the projection target (actor En).

  In the above-described embodiment, the projection mapping has been described as an example in which the projection image Pi is pasted (projected) on a fixed projection object (actor En in a pose with both hands raised), but the present invention is not limited to this. In addition, the projected image Pi can be projected onto a projection object (actor En) having a motion (dancing, walking, etc.). When the projection image Pi is projected onto the moving projection object (actor En) (the content image Cp is pasted), the projection position of the projection image Pi and the projection object (actor En) are aligned (rehearsed) in advance. However, it is impossible for the projection object (actor En) to move without any difference from when the alignment is performed, and a deviation occurs.

  During the projection, the position of the marker Mr included in the projection image Pi is superimposed on the feature position Pp of the projection target (actor En) to align the projection target (actor En) and the projection video Pi. Even when the position of the body (actor En) is different from that at the time of the rehearsal, it is possible to appropriately correct the projection image Pi so that it is accurately projected onto the projection target (actor En).

  Note that the position correction of the projected image Pi can be performed by detecting the marker Mr and detecting the feature position Pp at a constant cycle and correcting the position of the projected image Pi by the above-described method.

  Further, it is possible to acquire more information by changing the shape of the marker Mr. FIG. 13A is a diagram showing a shape of a marker used in the projection system according to the present invention, and FIG. 13B is a diagram showing a detected marker. As shown in FIGS. 13A and 13B, the marker Mrr of the marker video Mp1 has a cross shape.

  As shown in FIGS. 13A and 13B, the cross-shaped marker Mrr can detect how much the projection object is inclined with respect to the original shape when the projection object rotates around the optical axis of the projected image. Then, by detecting the inclination angle of the marker Mrr, it is possible to detect the rotation angle around the optical axis of the projection image of the projection image Pi. In the case of detecting the tilt angle using the marker Mrr, the marker detecting unit 31 can detect the shape of the marker Mrr. In addition, the detection of the inclination of the marker Mrr may be performed by the marker detection unit 31 or may be performed by the processing unit 7 that has acquired the information of the marker Mrr from the marker detection unit 31.

  Thus, by detecting the rotation angle of the projection image Pi from the inclination of the marker Mrr around the optical axis, it is possible to project the projection image Pi by rotating it at an accurate angle.

  In addition to the cross shape, a shape that does not overlap when rotated (for example, a triangle, an ellipse, etc.) can be widely adopted, and a shape that does not overlap except when rotated once is preferable. In the present embodiment, all the markers of the projected image Pi are cross-shaped markers Mrr. However, if at least one cross-shaped marker Mrr is provided, the rotation angle around the optical axis can be detected.

(Third embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 14 is a block diagram of another example of the projection system according to the present invention. A projection system A2 shown in FIG. 14 has the same configuration as the projection system A except that the storage unit 5 includes a position storage unit 53. Therefore, in the projection system A2, the same components as those of the projection system A are denoted by the same reference numerals, and detailed description of the same parts is omitted.

  In the projection system A2 shown in FIG. 14, the storage unit 5 includes a position storage unit 53. The position storage unit 53 stores information on the position of the feature position Pp detected by the feature position detection unit 32. In the projection system A2, the feature position detection unit 32 periodically detects the feature position Pp of the projection target (actor En). Therefore, the position storage unit 53 stores information on the feature position Pp in the detected time series.

  In the case where the projection system A2 is configured to project the projection image Pi onto a moving projection object (actor En), the feature position Pp moves in accordance with the movement of the projection object (actor En). When performing projection mapping, the motion of the projection target (actor En) is determined in advance. A content video Cp and a marker video Mp are prepared so as to match the movement.

  However, it is difficult for the projection object (performer En) to perform a predetermined movement without any difficulty, and a shift between the projection image Pi and the projection target (actor En) occurs with the movement. As described above, the control (feedback control) for suppressing the deviation is performed by periodically detecting the positions of the feature position Pp and the marker Mr and performing the projection correction of the projection image Pi. There is a delay in the control.

  When performing projection mapping, the content video Cp and the marker video Mp are given in advance in accordance with the movement of the projection object (actor En), and the processing unit 7 grasps the movement of the next projection object (actor En). doing. Using this and the fact that the position of the previous characteristic position Pp of the projection object (actor En) is stored in the position storage unit 53, the processing unit 7 uses the position of the next projection object (actor En). It is possible to perform control (feedforward control) such that the projection calculation is performed and the projected video is projected to the predicted position.

  In this way, by using the feedforward control and the feedback control, it is possible to accurately align the projection image Pi with the projection target (actor En). Note that either one of the feedforward control and the feedback control may be used, or each control may be performed in a situation where each is good.

(Fourth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. 15A to 15C are diagrams showing an example of a state in which an image is projected using the projection system according to the present invention, and FIGS. 16A to 16C are projections of the images shown in FIGS. 15A to 15C. It is a figure which shows the characteristic position when there is.

  FIGS. 15A to 15C show a projection object (actor En) performing the operation of lifting the hat Ht with the right hand (FIG. 15B) and throwing the hat Ht (FIG. 15C) from the state of wearing the hat Ht (FIG. 15A). ) Is projected the projected image Pi.

  As shown in FIG. 15A, the content video Cp is also pasted on the hat Ht. Therefore, in the projected image Pi of FIG. 15A, the markers Mr are set to the right hand tip Mr1, the hat Mr21, the trunk center Mr3, and the left foot tip Mr4. As described above, the point corresponding to the marker Mr, the right hand tip Pp1, the hat Pp21, the torso center Pp3, and the left foot tip Pp4 of the outer shape image Fp are detected as the feature position Pp (see FIG. 16A). Since the hat Ht is worn on the head, the face marker and the characteristic position are omitted.

  When the hat Ht is lifted with the right hand as shown in FIG. 15B, the right hand tip is hidden by the hat Ht. Therefore, in the projected image Pi, when the hat Ht is lifted with the right hand, the right hand is hidden by the hat Ht. At this time, the hat Ht and the right hand tip are set by the marker Mr of the hat Ht. At this time, the characteristic position Pp is also set as the characteristic position of the right hand and the hat Ht using the characteristic position Pp21 of the hat Ht. At this time, a marker Mr2 indicating the face portion is generated, and similarly the feature position Pp2 of the face portion is detected (see FIG. 16B).

  When the hat Ht is thrown as shown in FIG. 15C, the hat Ht moves to a position away from both the right hand and the face. Therefore, the marker Mr21 of the hat Ht moves together with the hat Ht, and the right-hand marker Mr1 is generated. Similarly, at this time, the feature position Pp of the hat Ht is separated from the right hand tip, and the feature position Pp1 of the right hand tip is detected (see FIG. 16C).

  As described above, the projected image Pi can be accurately aligned with the projection object (actor En) by moving and increasing / decreasing the marker Mr and the feature position Pp as necessary. Further, since it is possible to reduce the number of markers Mr, it is possible to simplify the detection of the marker and the detection of the characteristic position, and accordingly, the projection correction of the projection image Pi to the projection target (actor En) is performed quickly. be able to.

(Fifth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 17 is a block diagram of still another example of the projection system according to the present invention. A projection system A3 shown in FIG. 17 includes a projection unit 1 and a projection unit 11 having the same configuration as the projection unit 1. The projection system A3 includes a projection correction unit 2 and a projection correction unit 20 that corrects the projection of the projection unit 11. Other than this, the projection system A3 has the same configuration as the projection system A, and substantially the same parts are denoted by the same reference numerals, and detailed descriptions thereof are omitted.

  As shown in FIG. 17, in the projection system A3, the projection unit 1 and the projection unit 11 project the projection image Pi onto a common object to be projected. At this time, the projection unit 1 and the projection unit 11 may project the same projection image Pi, or may project different projection images.

  By projecting the same projected image Pi onto the projection target, the projected image can be projected more clearly. Even if one of the projection units and / or the projection correction unit is faulty, defective, or the like and cannot be accurately projected, the other projection unit and / or the projection correction unit projects the projection. It can be carried out. Thereby, it can suppress that the projection of a projection image | video stops.

  In addition, it is possible to widen the projection range by projecting different projected images. Further, by adopting a configuration for projecting different projection images, it is possible to project different projection images with different motions on the projection target. For example, when a projected image is projected onto a thrown hat Ht as in the fourth embodiment, the hat Ht does not always move to a predetermined position. In such a case, the projection image projected onto the hat Ht is projected using one projection unit, and the feature position Pp is detected based on the information of the marker Mr. Even if Ht is not thrown to a fixed position, the projected image can be accurately projected onto the hat Ht.

  In this embodiment, two projection units and two projection correction units are provided, but the number is not limited to two, and three or more projection units may be provided. Moreover, it is good also as a structure provided with two or more detection parts. By increasing the number of detection units, it is possible to increase the detection range and / or accuracy. For example, by providing a detection unit for each of the plurality of projection units, it is possible to detect markers and feature positions that are difficult to detect.

(Sixth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 18 is a diagram of the characteristic position of the projection target when the moving speed changes. FIG. 18 assumes that a projected image is projected onto a projection target (actor En who is moving). In the present embodiment, it is assumed that the projection system A2 is used.

  FIG. 18 shows one of the characteristic positions of three types of projection objects. The characteristic position (knee) Pp51 of the projection object (actor En1) raising both hands in a stationary state, the projection object walking A characteristic position (knee) Pp52 of (actor En2) and a characteristic position (knee) Pp53 of a running subject (actor En3) are shown.

  When projecting a projection image onto a stationary object (actor En1), the viewer can easily notice whether the projection object (actor En1) or the projection image is small. Therefore, when projecting a projected image on a stationary projection object (actor En1), the projection correction is performed so that the feature position Pp51 is reduced and the marker is superimposed on the feature position Pp51. The size of the feature position Pp51 can be the same size as the marker to be overlaid.

  On the other hand, when projecting a projection image onto a moving projection object, even if the projection object and the projection image are slightly deviated from each other, it is difficult for the viewer to recognize the deviation. Therefore, when projecting a projection image onto a walking projection object (actor En2), the size of the feature position Pp52 is made larger than the feature position Pp51. Then, the projected video is blurred and projected. In addition, when projecting a projected image on a running projection object (actor En3), the size of the feature position Pp53 is made larger than the feature position Pp52. Furthermore, it is preferable that the projected image is blurred and projected. Here, “increase the feature position” means to increase the portion (color object, shape object) that becomes the mark of the feature position of the projection object corresponding to each marker.

  In this way, by changing the projected video and performing the projection correction, it is possible to keep the ability required for the processing low. It should be noted that the size of the feature position where the marker is superimposed is varied according to the moving speed of the projection target. The moving speed of the projection object is determined based on the feature position stored in the position storage unit 53 and information at that time. Further, the blur of the projected video may be performed using the lens unit 22 or may be performed by image processing of the image generation unit 4. The degree of blurring may be changed according to the speed or may be constant.

  When a plurality of markers are used, the size of the feature position may be changed depending on the location where the video is projected and the content of the projected video (content video). For example, the feature position is increased for a portion that is less affected even if it is slightly deviated, such as a torso, and the feature position is decreased for a portion that projects an uncomfortable image even if a small size such as glasses or a tie occurs. As described above, in the case of a configuration employing different feature position sizes, it is preferable to include a plurality of projection units because the degree of blurring and the alignment accuracy of the image projected on each feature position are different.

(Seventh embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 19 is a block diagram showing still another example of the projection system according to the present invention. A projection system A4 shown in FIG. 19 has the same configuration as the projection system A except that it includes a position detection unit 8 that detects a relative position between the projection unit 1 and the detection unit 3. Therefore, in the projection system A4, substantially the same parts as those of the projection system A are denoted by the same reference numerals, and detailed description of the same parts is omitted.

  When the projection system Pi aligns the projection image Pi with the projection target, the detection unit 3 (marker detection unit 31 and feature position detection unit 32) detects the position of the projection unit 1 that performs projection, the marker, and the feature position. If the relative position with respect to the projection object is not accurately detected, it is difficult to perform accurate alignment. Normally, the projection unit 1 and the detection unit 3 do not move once they are arranged, but for example, the operator may touch and shift and move.

Therefore, the projection system A4 includes a position detection unit 8 that detects the relative positions of the projection unit 1 and the detection unit 3. As the position detection unit 8, a unit including a sensor using infrared rays can be used. However, the present invention is not limited to this. For example, a member (part) that outputs signals such as light and radio waves from the projection unit 1 and the detection unit 3 may be provided and position detection may be performed by detecting the signals. Furthermore, the projection unit 1 and the detection unit 3 have GPS (Global
(Positioning System) receiver may be attached, and position information of each of the projection unit 1 and the detection unit 3 may be acquired using a GPS signal.

  Since the projection system A4 includes the position detection unit 8, the relative positional relationship between the projection unit 1 and the detection unit 3 can be accurately detected, and the projection image Pi is accurately aligned with the projection target. Is possible.

  In the present embodiment, the projection unit 1 and the detection unit 3 are accurately positioned and installed in advance, but the present invention is not limited thereto. In the projection system A4, after the projection unit 1 and the detection unit 3 are installed, the relative positional relationship between the projection unit 1 and the detection unit 3 is detected, and the projection image Pi is projected according to the relative positional relationship. Also good. Further, based on the relative position between the projection unit 1 and the detection unit 3 detected by the position detection unit 8, the projection video Pi can be accurately projected onto the projection target and the projection correction can be performed accurately. As described above, the position of the projection unit 1 and / or the detection unit 3 may be adjusted. The alignment of the projection unit 1 and the detection unit 1 may be performed automatically or may be performed by an operator.

  Further, depending on the projection mapping expression method, the projection unit 1 may be moved while projecting the projection image Pi. Even when the projection unit 1 moves, the position detection unit 8 can detect the position of the projection unit 1, so that the projection image Pi can be accurately projected onto the projection target.

(Eighth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 20 is a block diagram of still another example of the projection system according to the present invention. The projection system A5 shown in FIG. 20 has a configuration in which the projection unit 1, the projection correction unit 2, and the detection unit 3 are connected to the arithmetic device 71.

  As shown in FIG. 20, the projection system A5 includes a calculation device 71, and the calculation device 71 includes an image generation unit 4, a storage unit 5, an operation unit 6, and a processing unit 7. Examples of the arithmetic device 71 include general-purpose information devices such as personal computers, tablet PCs, and smartphones.

  The arithmetic device 71 is a general-purpose information device, and performs processing specialized for the projection system A5 using a program (application). As described above, the projection system 1, the projection correction unit 2, and the detection unit 3 are connected to the general-purpose arithmetic device 71, so that the projection system according to the present invention is provided using the existing equipment. be able to. In many cases, the arithmetic device 71 uses a device having a higher arithmetic processing capability than that of a dedicated device, and it is possible to increase the alignment accuracy of the projection image Pi with respect to the projection target by speeding up the arithmetic processing.

  The connection between the arithmetic device 71 and the projection unit 1, the projection correction unit 2, and the detection unit 3 may be wired or wireless.

(Ninth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 21 is a block diagram of still another example of the projection system according to the present invention. 22A is a diagram showing the characteristic position of the projection object detected by the projection system shown in FIG. 21, and FIG. 22B is a diagram showing the outline of the projection object detected by the projection system shown in FIG. The projection system A6 shown in FIG. 21 has the same configuration as the projection system A except that it includes the contour detection unit 33. In the projection system A6, parts that are substantially the same as those in the projection system A are denoted by the same reference numerals, and detailed description of the same parts is omitted. Further, it is assumed that the projection target having the contour shown in FIG. 22B is the same as the projection target (actor En) shown in FIG.

  The projection system A6 includes a contour detection unit 33 that detects the contour Rk of the projection target (actor En). Further, the projection system A6 detects the characteristic position Pp of the projection target (actor En). In the projection system A6, the characteristic position Pp (here, the knee Pp6) is associated with the contour Rk of the projection target (actor En) and sent to the processing unit 7. The image generation unit 4 cuts out a video to be pasted on the projection target (actor En) based on the information on the contour Rk. More specifically, a single color video, a video in which a plurality of colors are not affected by the shape, or a video in which patterns are arranged (content video Cp) is cut out in the shape of the contour Rk. Then, the projected image Pi is generated by mixing the marker Mr with the cut image.

  Thus, by detecting the contour Rk, it is possible to easily generate the projection video Pi to be projected onto the projection target (actor En). Then, by generating the projection video Pi according to the contour Rk, the projection video Pi can be accurately projected onto the projection target (actor En) even when the operation of the projection target (performer En) is unknown. Is possible. Further, when the motion of the projection target (actor En) is determined in advance, the projection video Pi is projected using the contour Rk and information on the motion of the predetermined projection target (actor En). It is possible to accurately align (projection correction) with the body (actor En).

(10th Embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 23 is a plan view showing the arrangement of the projection unit and the detection unit of the projection system according to the present invention. In this embodiment, the projection system A is used, and the arrangement position of the projection unit 1 and the detection unit 3 and the detection of the marker are characteristic.

  As shown in FIG. 23, the performer En who is the projection object performs in front of the planar background Bs provided on the stage St. The viewer views the performer En from the front side of the stage St, and the projection unit 1 is arranged to project the projection video Pi from the front of the stage St. On the other hand, in order to accurately detect the projection target (actor En), the detection unit 3 is arranged at a position that forms a certain angle with the projection unit 1 with the projection target as the center.

  By arranging in this way, it is possible to accurately detect the performer En (characteristic position Pp) even when the projection image Pi overlaps the projection target (actor En). In addition, in this way, the marker Mr included in the projection image Pi is detected from different angles. Since the detection angle of the detection unit 3 is different from the projection angle of the projection unit 1, it can be determined whether or not the marker Mr is projected on the background Bs. When detecting that the marker Mr is projected on the background Bs, the processing unit 7 can determine that the projection video Pi is not accurately aligned with the projection target (actor En). Thereby, it is possible to accurately project the projection image Pi on the projection target (actor En). The detection unit 3 can efficiently detect the entire stage St by arranging it so that it can be detected.

(Eleventh embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 24 is a block diagram of still another example of the projection system according to the present invention. In the above projection system, the marker Mr is projected as a visible image together with the content image Cp as the projected image Pi. When appreciating the projected video Pi projected onto the projection object, if the marker Mr unrelated to the content video Cp is viewed, the expression effect of projection mapping is reduced. In the projection system A described above, the marker Mr has a color, shape, and position that is inconspicuous from the viewer in the projection image Pi, and makes the marker Mr less conspicuous.

  However, depending on the configuration of the content video Cp and the shape of the projection target, it may be difficult to hide the marker Mr well (make it inconspicuous). Therefore, in the projection system A7 shown in FIG. 24, the projection unit 1 includes the visible light projection unit 10 and the infrared projection unit 12 capable of projecting infrared light, and the detection unit 3 performs infrared detection. Part 34 is provided.

  In the projection system A7, the content video Cp is projected by the visible light projection unit 10 of the projection unit 1, and the marker video Mp is projected by the infrared projection unit 12. That is, since the content video Cp is projected on the projection target using visible light and the marker video Mp is projected using invisible infrared light, the marker Mr is not viewed by the viewer.

  The marker Mr is detected by the infrared detector 34 of the detector 3. Thereby, even when the content video is pasted on the projection object, the position of the marker Mr can be accurately detected.

  Since the marker video Mp is projected by the infrared projection unit 12, the projection video Pi does not need to mix the content video Cp and the marker video Mp. Therefore, when the content video Cp and the marker video Mp are supplied from the storage unit 5 to the image generation unit 4, the content video Cp is modified to be adapted to the projection object as the projection video Pi, and the marker video Mp The marker image Mp may be sent to the infrared projection unit 12 so that the position with the projection image Pi is accurately aligned. Similarly to the above, the projection video Pi may be generated, and the projection unit 1 may send the content video Cp and the marker video Mp to the visible light projection unit 10 and the infrared projection unit 12, respectively.

  In this embodiment, the marker image Mp is configured to be projected with infrared light. However, a part of the marker image Mp may be projected with infrared light, and visible light and infrared light (as required). The projection may be performed by switching to invisible light.

  In addition, although the infrared projection unit 12 that projects the marker image using infrared rays is used, the present invention is not limited to this, and an invisible projection unit that projects the image so that the viewer cannot see it is used. May be. For example, although ultraviolet light may be used, infrared light is more preferable from the viewpoint of safety. Highly safe products can be widely used.

(Twelfth embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 25 is a diagram showing detected markers and feature positions. In the present embodiment, the projection system A is used, which has a feature in the alignment operation of the projection image Pi. The marker Mr and the feature position Pp adopt the same state as the projection state shown in FIG.

  FIG. 25 shows the position of the marker Mr detected by the marker detection unit 31 and the feature position Pp detected by the feature position detection unit 32. Usually, since the position of the marker Mr and the position of the feature position Pp correspond to each other, the array of the marker Mr and the array of the feature position Pp are the same or similar. Comparing the arrangement of the markers Mr1 to Mr4 shown in FIG. 25 with the arrangement of the feature position Pp, it can be seen that the position of the marker Mr4 is greatly deviated from the feature position Pp4. At this time, the processing unit 7 can quickly notify the operator of the malfunction using the display unit (not shown) that the marker Mr4 and the characteristic position Pp4 are misaligned.

  Note that the markers Mr1 to Mr4 and the characteristic positions Pp1 to Pp4 may not accurately overlap depending on the position, angle, etc. of the projection target (actor En). In such a case, there is a case where the range of correction is corrected by the projection correction of the projection image Pi and a case where there is a problem as described above. As a method for determining whether the projection correction should be performed or not, for example, the amount (or ratio) of the deviation between the marker Mr and the feature position Pp may be determined in advance.

  The processing unit 7 stores the detection result by the marker detection unit 31 and the detection result by the feature position detection unit 32 in the storage unit 5, and information on movement of each point and a predetermined projection object ( The information of the movement of the performer En) is compared. Then, it is determined which of the detected marker and the feature position has an error (error), and the input having the error (detection result) is ignored. Thus, when it is set as the structure which detects an error based on the information accumulated so far, the process part 7 can stop an input automatically. Thereby, it is possible to accurately project the projection image Pi onto the projection target.

(13th Embodiment)
Still another example of the projection system according to the present invention will be described with reference to the drawings. FIG. 26 is a block diagram of still another example of the projection system according to the present invention. A projection system A8 shown in FIG. 26 includes a marker receiving unit 35 attached to a performer En that is a projection target. Other than that, it has the same configuration as the projection system A, and substantially the same parts are denoted by the same reference numerals and detailed description thereof is omitted.

  In the present embodiment, the feature position is determined at a predetermined position of the projection target. A marker receiver 35 is attached to the characteristic position of the projection target. The marker receiving unit 35 includes a sensor that can detect the marker Mr in the projection image Pi projected from the projection unit 1. When the marker receiving unit 35 detects the marker Mr, the processing unit 7 determines that the projection is correctly performed. When the marker receiving unit 35 does not receive the marker Mr, the projection video Pi is a projection object ( Judge that he is out of the performer En).

  Thus, since it is the structure which attaches the marker receiving part 35 to a to-be-projected body (performer En), it is possible to abbreviate | omit the marker detection part and characteristic position detection part of the detection part 3. FIG.

  As mentioned above, although embodiment of this invention was described, this invention is not limited to this content. The embodiments of the present invention can be variously modified without departing from the spirit of the invention.

A, A2 to A8 Projection system 1 Projection unit 10 Visible projection unit 11 Projection unit 12 Infrared projection unit 2 Projection correction unit 20 Projection correction unit 21 Optical axis shift unit 22 Lens unit 23 Controller 3 Detection unit 31 Marker detection unit 32 Characteristic position Detection unit 33 Contour detection unit 4 Image generation unit 5 Storage unit 51 Content video storage unit 52 Marker video storage unit 6 Operation unit 7 Processing unit 71 Calculation unit 8 Position detection unit Cp Content video Mp Marker video Mr1 to Mr4 Markers Pp1 to Pp4 Features Position Fp Outline image Sp Reference image Pi Projected image En Performer (projected object)

Claims (16)

A projection unit that projects onto the projection object a projection image in which a marker is included at a predetermined position of the content image to be projected onto the projection object;
A detection unit that detects a feature position of the projection object corresponding to the predetermined position and a position of the marker;
A projection system comprising: a projection correction unit configured to perform alignment correction of the projection image with respect to the projection target so that the feature position and the marker position have a predetermined positional relationship. An image generation unit that generates the projection video by adding the marker to the content video;
The projection system according to claim 1, wherein the image generation unit determines the number of markers and the position of the markers based on the content video. The image generation unit can perform image processing,
The projection system according to claim 2, wherein the image generation unit generates a projection video including a content video subjected to image processing according to the alignment correction.   The projection system according to claim 2, wherein the image generation unit uses a shape capable of detecting a rotation angle as at least one of the markers.   The projection system according to claim 1, wherein the detection unit includes a contour detection unit that detects a contour of the projection target. The detection unit includes a contour detection unit that detects a contour of the projection object,
The projection system according to any one of claims 2 to 4, wherein the image generation unit generates a projection video in association with an outline of the projection target. The projection unit can project at least a part of the marker with invisible light;
The projection system according to claim 1, wherein the detection unit can also detect a position of the marker projected with the invisible light.   The projection system according to claim 7, wherein the projection unit can project at least a part of projection light of the marker by switching between visible light and invisible light.   9. The projection system according to claim 1, comprising a plurality of projection units so that projection images can be projected onto the projection object from a plurality of different positions.   The projection system according to claim 9, wherein the projection images projected from the different positions each include a different marker.   The projection system according to any one of claims 1 to 10, wherein the projection unit and the detection unit are arranged at positions having a fixed angle with the projection target as a center.   The projection system according to claim 1, wherein the projection target is a moving body. The detection unit detects a moving speed of the projection object,
The projection system according to claim 12, wherein the projection correction unit greatly corrects the characteristic position when a movement speed of the projection target increases.   The projection system according to claim 1, further comprising a position detection unit that detects a relative position between the detection unit and the projection unit. The detection unit is
A feature position detector for detecting the feature position of the projection object;
The projection system according to claim 1, further comprising: a marker detection unit that detects a position of the marker.   The projection system according to claim 15, further comprising a position detection unit that detects a relative position between the characteristic position detection unit and the projection unit, and at least one relative position between the marker detection unit and the projection unit.

Images