WO2021182214A1 - Photography system, photography method, and program - Google Patents
Photography system, photography method, and program Download PDFInfo
- Publication number
- WO2021182214A1 WO2021182214A1 PCT/JP2021/008096 JP2021008096W WO2021182214A1 WO 2021182214 A1 WO2021182214 A1 WO 2021182214A1 JP 2021008096 W JP2021008096 W JP 2021008096W WO 2021182214 A1 WO2021182214 A1 WO 2021182214A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- projector
- camera
- projection
- time
- shielding
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 53
- 230000001360 synchronised effect Effects 0.000 claims abstract description 20
- 238000003384 imaging method Methods 0.000 claims description 21
- 230000008859 change Effects 0.000 claims description 14
- 230000008569 process Effects 0.000 description 20
- 230000010365 information processing Effects 0.000 description 16
- 230000004397 blinking Effects 0.000 description 15
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 description 15
- 230000000694 effects Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 239000004973 liquid crystal related substance Substances 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000005259 measurement Methods 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 3
- 238000012937 correction Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- 230000000903 blocking effect Effects 0.000 description 1
- 239000004020 conductor Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000001151 other effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000002834 transmittance Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/56—Accessories
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B9/00—Exposure-making shutters; Diaphragms
- G03B9/08—Shutters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
Definitions
- the present invention relates to a photographing system, a photographing method and a program.
- Patent Document 1 is known as a technique for preventing the projected light from being reflected in the captured image.
- the shooting cycle of the camera and the projection cycle of the projector are synchronized.
- a photographing system including a camera, a projector, and a shutter device that synchronizes with the camera or the projector and blocks light projected from the projector and incident on the camera. Further, according to the present disclosure, there is provided a photographing method in which the information processing of the photographing system is executed by a computer, and a program for realizing the information processing of the photographing system in the computer.
- FIG. 1 is a schematic view of the photographing system 1 of the first embodiment.
- the photographing system 1 includes, for example, an information processing device 110, a projector 120, a shutter device 130, a camera 140, and a transmitter 150.
- the information processing device 110 generates an image projected by the projector 120.
- the information processing device 110 includes, for example, a 3D model storage unit 111, a parameter storage unit 112, a display content generation unit 113, and a correction video generation unit 114.
- the 3D model storage unit 111 reads and stores, for example, the 3D model of the studio ST from the information input to the information processing device 110.
- the parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 120 and the position / orientation information of the projector 120 in the 3D model from the input information.
- the display content generation unit 113 generates, for example, the content projected on the studio ST.
- the content includes information that supports the performance of the performer AC.
- the content includes, for example, the standing position of the performer AC, a conductor indicating the movement path of the performer AC, and a CG character existing around the performer AC.
- the corrected video generation unit 114 geometrically corrects the content using, for example, the content edited by the user, the internal parameters of the 3D model and the projector 120, and the position / orientation information of the projector 120 in the 3D model, and generates the corrected video.
- the corrected video generation unit 114 transmits the video source of the corrected video to the projector 120.
- the information processing device 110 is, for example, a computer composed of a processor and a memory.
- the memory of the information processing apparatus 110 includes a RAM (Random Access Memory) and a ROM (Read Only Memory).
- the information processing device 110 functions as a display content generation unit 113 and a corrected video generation unit 114 by executing an information processing program (not shown).
- the projector 120 has, for example, a video output unit 121 and a projection unit 122.
- the video output unit 121 is a processor in the projector 120.
- the video output unit 121 converts the video source received from the corrected video generation unit 114 into a projected video signal and outputs it to the projection unit 122.
- the projection unit 122 projects an image based on the image source to a target location of the studio AT.
- the image of the content corrected for distortion is projected on the studio ST according to the position / orientation information of the 3D model and the projector 120.
- the projection unit 122 projects an image at a predetermined refresh rate.
- known projection methods such as a 3LCD (Liquid Crystal Display) method, an LCOS (Liquid Crystal on Silicon) method, and a DLP (Digital Light Processing; registered trademark) method are adopted.
- the video output unit 121 and the projection unit 122 have known structures.
- a general-purpose machine is used for the projector 120.
- Camera 140 captures the performer AC acting in the studio ST.
- the camera 140 shoots at a predetermined frame rate.
- the camera 140 includes, for example, an exposure time setting unit 141, a synchronization control unit 142, a synchronization signal output unit 143, an exposure control unit 144, an imaging unit 145, and a recording unit 146.
- the exposure time setting unit 141 sets the frame rate of the camera 140 and the exposure time (shutter speed) of the camera 140 within one frame period.
- the frame rate is set to, for example, a setting value input by the user.
- the exposure time is set, for example, manually or automatically. In the manual mode, the exposure time is set to a set value entered by the user. In the automatic mode, the exposure time is automatically set based on, for example, the brightness of the shooting environment.
- the exposure time setting unit 141 synchronously controls information (frame rate and exposure time) regarding the changed exposure timing when the exposure timing is changed by changing at least one of the frame rate and the exposure time, for example. Output to 142.
- the synchronization control unit 142 generates a synchronization signal based on the exposure time.
- the synchronization control unit 142 outputs a synchronization signal to the synchronization signal output unit 143 and the exposure control unit 144.
- the synchronization signal output unit 143 causes the transmitter 150 to transmit a signal indicating the exposure timing of the camera 140 based on the synchronization signal.
- the exposure control unit 144 opens and closes the camera shutter in accordance with the synchronization signal.
- the camera shutter is, for example, a focal plane shutter or a lens shutter provided inside the camera 140. The camera shutter opens only during the exposure period of the camera 140 so that the image sensor of the camera 140 is exposed to light only during shooting, and shields the light during other periods.
- the transmitter 150 is, for example, an IR (Infrared) emitter that transmits an infrared signal.
- the transmitter 150 is connected to the camera 140 by, for example, a synchronization signal line.
- the synchronization signal output unit 143 blinks the transmitter 150 for a predetermined time in accordance with the synchronization signal, for example.
- the transmitter 150 is lit when the camera 140 is exposed (when the camera shutter is open), and the transmitter 150 is turned on when the camera is not exposed (when the camera shutter is closed).
- the transmitter 150 is blinked in a pattern that turns off the light.
- the exposure timing of the camera 140 and the lighting timing of the transmitter 150 may be opposite to each other.
- the blinking time (time when a signal is transmitted from the transmitter 150) is determined based on the time required to synchronize the exposure timing of the camera 140 and the shielding timing of the shutter device 130. For example, the blinking time is a time of 1 frame period or more and 10 frame period or less.
- the imaging unit 145 intermittently captures an image at a predetermined frame rate according to the opening / closing timing of the camera shutter.
- the recording unit 146 records an image taken by the imaging unit 145.
- the shutter device 130 shields the light projected from the projector 120 and incident on the camera 140.
- the shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal.
- the shutter device 130 synchronizes with the camera 140 and shields the light projected from the projector 120 in accordance with the exposure timing of the camera 140.
- the shutter device 130 includes, for example, a receiving unit 131, a storage unit 132, a shutter control signal generation unit 133, a shutter control unit 134, and a shutter member 135.
- the receiving unit 131 receives the signal transmitted from the transmitter 150. For example, the receiving unit 131 binarizes the amount of received light to detect whether the transmitter 150 is lit or not lit. The receiving unit 131 detects the exposure timing based on the received signal. For example, the receiving unit 131 detects the exposure time and the exposure cycle (frame rate) of the camera 140 based on the lighting time and the lighting cycle of the transmitter 150. The receiving unit 131 outputs information indicating the exposure timing of the camera 140 to the shutter control signal generation unit 133.
- the shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131.
- the shutter control signal is, for example, a signal having information on the shielding time and the shielding cycle corresponding to the lighting time and the lighting cycle of the transmitter 150.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal. As a result, the shutter device 130 dynamically changes the shielding time for shielding the light projected from the projector 120 according to the exposure time of the camera 140.
- the shutter member 135 is, for example, a liquid crystal shutter whose visible light transmittance changes depending on the voltage.
- the shutter member 135 is arranged, for example, on the optical axis of the light projected from the projection unit 122.
- the shutter member 135 transmits, for example, the light projected from the projection unit 122 when no voltage is applied.
- the shutter member 135 shields the light projected from the projection unit 122 when a voltage equal to or higher than the threshold value is applied.
- the shutter device 130 includes a computer composed of a processor and a memory.
- the storage unit 132 stores the program PG that causes the computer to execute the processing of the shutter device 130.
- the shutter device 130 functions as a receiving unit 131, a storage unit 132, a shutter control signal generation unit 133, and a shutter control unit 134 by executing the program PG.
- the storage unit 132 includes any non-transient storage medium such as a semiconductor storage medium and a magnetic storage medium.
- the storage unit 132 includes, for example, an optical disk, a magneto-optical disk, or a flash memory.
- the program is stored, for example, in a non-transient storage medium that can be read by a computer.
- FIG. 2 is a flowchart illustrating an example of the photographing method of the present embodiment.
- step S1 the synchronization control unit 142 determines the blinking pattern of the transmitter 150 based on the exposure time set by the exposure time setting unit 141.
- step S2 the transmitter 150 starts blinking in the blinking pattern determined by the synchronization control unit 142.
- the transmitter 150 transmits a signal using blinking light as a signal indicating the exposure timing of the camera 140.
- step S3 the receiving unit 131 receives the signal transmitted from the transmitter 150.
- the shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131.
- the shutter control unit 134 synchronizes the shielding timing of the shutter member 135 with the exposure timing of the camera 140 based on the shutter control signal.
- step S4 the exposure time setting unit 141 determines whether or not the exposure time has been changed.
- the exposure time setting unit 141 determines that the exposure time has been changed, for example, when the user manually sets the exposure time or when the exposure time is automatically changed based on the change in the brightness of the shooting environment. do.
- step S4 If it is determined in step S4 that the exposure time has been changed (step S4: Yes), the process returns to step S1.
- step S4 determines whether or not to end the shooting.
- the camera 140 determines that the shooting has been completed, for example, when the shooting end button (not shown) provided on the camera 140 is operated.
- step S5 If it is determined in step S5 that the shooting is finished (step S5: Yes), the camera 140 ends the shooting. If it is not determined in step S5 that the shooting is completed (step S5: No), the process returns to step S4.
- FIG. 3 is a flowchart illustrating an example of a process of synchronizing the camera 140 and the shutter device 130.
- the receiving unit 131 determines whether or not the transmitter 150 has started blinking.
- the receiving unit 131 determines that the blinking has started when the first lighting of the transmitter 150 is detected.
- the receiving unit 131 detects the timing at which the first lighting starts to be detected as the blinking start timing.
- step S11 If it is determined in step S11 that blinking has started (step S11: Yes), the process proceeds to step S12. In step S12, the receiving unit 131 starts measuring the lighting time for one cycle from the lighting start timing. If it is not determined in step S11 that the blinking has started (step S11: No), step S1 is repeated until the blinking starts.
- step S13 the receiving unit 131 determines whether or not the lighting for one cycle has been completed.
- step S13 When it is determined in step S13 that the lighting for one cycle is completed (step S13: Yes), the receiving unit 131 detects the timing when the lighting for one cycle is completed as the lighting end timing (lighting start timing). Then, in step S14, the measurement of the lighting time is completed. If it is not determined in step S13 that the lighting for one cycle is completed (step S13: No), step S13 is repeated until the lighting is completed.
- step S15 the receiving unit 131 starts measuring the extinguishing time for one cycle. Then, in step S16, the receiving unit 131 determines whether or not the lighting start timing of the next cycle after the elapse of the extinguishing time has been detected. When it is determined in step S16 that the lighting start timing of the next cycle is detected (step S16: Yes), the measurement of the extinguishing time for one cycle is completed. The receiving unit 131 detects the timing at which the lighting of the next cycle starts as the turning-off end timing for one cycle. If it is not determined in step S16 that the lighting start timing of the next cycle is detected (step S16: No), step S16 is repeated until the lighting start timing of the next cycle is detected.
- step S18 the receiving unit 131 detects the lighting time, the lighting time, and the lighting cycle for one cycle based on the detected lighting start timing, lighting end timing (lighting start timing), and lighting end timing for one cycle. do.
- the shutter control signal generation unit 133 determines, for example, the light shielding timing (shielding start time and shielding time) during one frame period based on the lighting time and the lighting cycle for one cycle.
- the shutter control signal generation unit 133 generates a shutter control signal based on the determined shielding timing.
- 4 and 5 are timing charts showing an example of the operation of the projector 120, the shutter device 130, the camera 140, and the transmitter 150.
- the shutter device 130 During the exposure period (camera shutter open), the shutter device 130 is in a shielded state (ON). During the non-exposure period (camera shutter closed), the shutter device 130 is in the non-shielded state (OFF).
- the projector 120 always projects an image.
- the shutter device 130 shields the projected light from the projector 120 at the timing when the projection of the projector 120 and the shooting of the camera 140 overlap.
- the image projected from the projector 120 is intermittently shielded by the shutter device 130 according to the exposure timing of the camera 140.
- the transmitter 150 is turned on during the exposure period and turned off during the non-exposure period.
- FIG. 4 is a timing chart when the exposure period (camera shutter open) and the non-exposure period (camera shutter closed) of the camera 140 are equal.
- the exposure time of the camera 140 and the non-shielding time of the shutter device 130 are equal. Therefore, a bright image is taken without significantly impairing the brightness of the projected image.
- FIG. 5 is a timing chart when the non-exposure time is longer than the exposure time. In the example of FIG. 5, a bright image is projected, but the brightness of the captured image is smaller than that of the example of FIG.
- FIG. 6 is a diagram showing the relationship between the brightness of the captured image and the brightness of the projected image.
- the brightness of the captured image and the brightness of the projected image change depending on the exposure time of the camera 140.
- the longer the exposure time the brighter the image will be.
- the longer the exposure time the longer the shielding time by the shutter device 130. Therefore, the projected image of the projector 120 becomes dark. Therefore, there is a trade-off between the brightness of the captured image and the brightness of the projected image.
- the user can manually set the exposure time based on the shooting phase, the studio ST environment, and the like in consideration of these trade-offs. Further, the exposure timing information detected by the receiving unit 131 can be output to the video output unit 121, and the video output unit 121 can correct the brightness of the projected image.
- FIG. 7 is a flowchart showing an example of the content presentation process to the performer AC by the projector 120.
- step S21 the 3D model storage unit 111 reads and stores the 3D model of the studio ST from the information input to the information processing device 110.
- step S22 the parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 120 and the position / orientation information of the projector 120 in the 3D model from the input information.
- step S23 the display content generation unit 113 generates projection content including information that supports the performance of the performer AC.
- the corrected image generation unit 114 geometrically corrects the projection content using the internal parameters of the 3D model and the projector 120 and the position / orientation information of the projector 120 in the 3D model, and generates a corrected image.
- step S24 the projector 120 projects the corrected image onto the studio ST.
- step S25 the corrected image is intermittently shielded by the shutter device 130 synchronized with the camera 140 in accordance with the exposure timing of the camera 140.
- step S26 the projector 120 determines whether or not to end the projection.
- the projector 120 determines that the projection has been completed, for example, when the projection end button (not shown) provided on the projector 120 is operated. If it is determined in step S26 that the projection has been completed (step S26: Yes), the projector 120 ends the projection. If it is not determined in step S26 that the projection has been completed (step S26: No), the process returns to step S23.
- FIG. 8 is a diagram showing another example of the method of generating the corrected video PI.
- FIG. 9 is a diagram showing an example of a corrected image PI projected from the projector 120.
- FIG. 8 shows a state in which a corrected video PI that supports the performances of two performers is input on the 3D model.
- the corrected image PI the standing position PI1 and the conducting wire PI2 for the performer AC1 and the standing position PI3 and the conducting wire PI4 for the performer AC2 are shown.
- a virtual camera having the same position and orientation and internal parameters of the current projector is placed on this 3D model, and the input content is photographed.
- the geometrically corrected image as shown in FIG. 9 is displayed on the floor surface of the studio ST.
- the photographing system 1 includes a camera 140, a projector 120, and a shutter device 130.
- the shutter device 130 synchronizes with the camera 140 and shields the light projected from the projector 120 and incident on the camera 140.
- the information processing of the photographing system described above is executed by the computer.
- the program of the present embodiment makes the computer realize the information processing of the above-mentioned photographing system.
- the light projected from the projector 120 is shielded by the shutter device 130 before being incident on the camera 140. Therefore, the light (image) projected from the projector 120 is not reflected in the image captured by the camera 140. The reflection of the projected image is suppressed by the shutter device 130 synchronized with the camera 140. Therefore, a general-purpose machine can be used for the projector 120. Therefore, a shooting system 1 capable of shooting at low cost while reducing the burden on the performer AC is provided.
- the shutter device 130 dynamically changes the shielding time for shielding the light projected from the projector 120 according to the exposure time of the camera 140.
- the projected light is suppressed from being reflected in the image of the camera even if the exposure time of the camera 140 changes.
- the photographing system 1 has, for example, a transmitter 150.
- the transmitter 150 transmits, for example, a signal indicating the exposure timing of the camera 140.
- the shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding timing based on this signal.
- the degree of freedom in arranging the camera 140 and the shutter device 130 is increased.
- FIG. 10 is a diagram showing a main part of the photographing system 2 of the second embodiment.
- the difference between the first embodiment and the first embodiment is that the projector 125 is different from the first embodiment during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 136 is synchronized with the exposure timing of the camera 140 after the change. This is the point at which the projection of light by the camera is stopped.
- the differences from the first embodiment will be mainly described.
- the receiving unit 137 generates a projection stop signal of the projector 125 based on the signal transmitted from the transmitter 150, for example. For example, when the fluctuation of the exposure time is larger than the threshold value, the receiving unit 137 outputs the projection stop signal to the projector 125 only during the period of receiving the signal from the transmitter 150. The receiving unit 137 does not output the projection stop signal to the projector 125, for example, when the fluctuation of the exposure time is within the threshold value.
- the video output unit 126 stops the output of the projected video signal to the projection unit 122 for a predetermined time after the transmitter 150 starts transmitting the signal, for example, based on the projection stop signal.
- the time at which the signal is transmitted from the transmitter 150 is set based on the time required to synchronize the camera 140 and the shutter device 136. Therefore, the projection of light by the projector 125 is stopped during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 136 is synchronized with the exposure timing of the camera 140 after the change.
- the projection stop signal is not output to the projector 125. Therefore, the shielding time is not changed.
- the shutter control signal generation unit 138 sets, for example, the shielding time of the shutter device 136 to be longer than the exposure time of the camera 140.
- the shielding period of the shutter device 136 is set so that the shielding start timing is earlier than the exposure start timing and the shielding end timing is later than the exposure end timing in one frame period of the camera 140.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the exposure time.
- FIG. 11 is a timing chart showing an example of the operation of the projector 125, the shutter device 136, the camera 140, and the transmitter 150.
- a buffer period of ⁇ t is provided on the shielding start side and the shielding end side, respectively.
- the shielding start timing is ⁇ t earlier than the exposure start timing
- the shielding end timing is ⁇ t later than the exposure end timing.
- the receiving unit 137 uses, for example, the buffer period as a threshold value as a reference for determining the projection stop.
- the receiving unit 137 generates a projection stop signal, for example, when the exposure time fluctuates beyond the buffer period.
- the receiving unit 137 does not generate a projection stop signal, for example, when the fluctuation of the exposure time falls within the buffer period.
- FIG. 12 is a flowchart illustrating an example of the photographing method of the present embodiment.
- step S31 the projector 125 projects an image supporting the performance of the performer AC on the studio ST.
- step S32 the receiving unit 137 determines whether or not the exposure time of the camera 140 has been changed based on the signal transmitted from the transmitter 150. If it is not determined in step S32 that the exposure time has been changed (step S32: No), step S32 is repeated until the exposure time is changed.
- step S32 If it is determined in step S32 that the exposure time has been changed (step S32: Yes), the process proceeds to step S33.
- step S33 the receiving unit 137 determines whether or not the fluctuation of the exposure time exceeds the threshold value.
- step S33 If it is determined in step S33 that the fluctuation of the exposure time exceeds the threshold value (step S33: Yes), the process proceeds to step S34.
- step S34 the receiving unit 137 outputs a projection stop signal to the projector 125.
- the projector 125 stops the projection of the image based on the projection stop signal.
- step S35 the shutter control signal generation unit 133 generates a shutter control signal based on the exposure timing information detected by the reception unit 137.
- the shutter control signal generation unit 138 sets the shielding time of the shutter device 136 to be longer than the exposure time of the camera 140.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the exposure time.
- step S33 If it is not determined in step S33 that the fluctuation of the exposure time exceeds the threshold value (step S33: No), the process proceeds to step S35.
- step S36 the camera 140 determines whether or not to end the shooting. If it is determined in step S36 that the shooting is finished (step S36: Yes), the camera 140 ends the shooting. If it is not determined in step S36 that the shooting is finished (step S36: No), the process returns to step S31.
- the projection of light by the projector 120 is stopped during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 130 is synchronized with the exposure timing of the camera 140 after the change. ..
- the projected light is suppressed from being reflected in the captured image of the camera 140 during the shielding timing adjustment period.
- the shielding time is not changed.
- a dead zone area where the shielding time does not change is provided. Therefore, even if the exposure time is changed frequently, the presentation of information by the projector 120 is unlikely to be hindered. For example, in a configuration in which the projection of light is stopped during the adjustment period of the shielding timing, if the exposure time is changed frequently, the presentation of information by the projector 120 may be hindered. By providing a dead zone region in the exposure time, such a problem can be suppressed.
- the shielding time of the shutter device 136 in one frame period of the camera 140 is longer than, for example, the exposure time of the camera 140.
- the projected image is not reflected in the captured image.
- the buffer period in the shielding period even if there is a lag in the processing of various devices, it is possible to suppress the projection image from being reflected in the captured image due to the lag.
- the projected light of the projector 120 is reflected in the captured image of the camera 140 during the period from the start of the shutter device 130 to the end of the shielding and the period from the start of closing the camera shutter to the end of closing. Is suppressed.
- FIG. 13 is a schematic view of the photographing system 3 of the third embodiment.
- the difference between the first embodiment and the first embodiment is that the shutter device 230 synchronizes with the projector 220 and shields the light projected from the projector 220 and incident on the camera 240.
- the differences from the first embodiment will be mainly described.
- the information processing device 210 has, for example, a projection time setting unit 215 in addition to the configuration of the first embodiment.
- the projector 220 has, for example, a synchronization control unit 223, a synchronization signal output unit 224, and a projection time control unit 225, in addition to the configuration of the first embodiment.
- the projection time setting unit 215 sets, for example, the refresh rate of the projector 220 and the projection time of the projector 220 within one refresh period.
- the refresh rate and projection time are set, for example, to the set values entered by the user. For example, when at least one of the refresh rate and the projection time is changed, the projection time setting unit 215 outputs the changed refresh rate and the projection time to the synchronization control unit 223.
- FIG. 14 is a diagram showing an example of a projection time setting screen.
- the information processing device 210 displays the projection time setting screen on the display device 216, for example.
- the display device 216 is, for example, a display device with a built-in touch panel, and also serves as an input device for inputting to the projection time setting screen.
- the projection time setting screen has, for example, an area for setting the refresh rate of the projector 220 and an area for setting the projection time of the projector 220.
- the refresh rate is set by the user clicking a radio button.
- the magnitude of the refresh rate presented as an option is higher than, for example, the frame rate (24 fps) used in filming movies and dramas. Whichever option is selected, the refresh rate of the projector 220 is higher than the frame rate of the camera 240.
- the settable range of projection time changes according to the refresh rate. For example, when the refresh rate is 60 Hz, the settable range of the projection time is in the range of 0.0 to 16.7 milliseconds. When the refresh rate is 120 Hz, the settable range of the projection time is in the range of 0.0 to 8.3 milliseconds.
- the projection time is set using, for example, the slide bar SB. For example, when the refresh rate is set to 60 Hz and the projection time is set to t seconds, the period from time 0 seconds to time t seconds within one refresh period is the projection period (the period during which the image is projected), and the rest. The period from time t seconds to time 16.7 seconds is the non-projection period (the period during which the image is projected).
- the synchronization control unit 223 generates a synchronization signal based on the projection time.
- the synchronization control unit 223 outputs a synchronization signal to the synchronization signal output unit 224 and the projection time control unit 225.
- the synchronization signal output unit 224 causes the transmitter 150 to transmit a signal indicating the projection timing of the projector 220 based on the synchronization signal.
- the projection time control unit 225 outputs information regarding the projection timing to the video output unit 221.
- the video output unit 221 generates a projected video signal so that the video is projected for a set projection time during one refresh period, for example. As a result, the projection unit 122 intermittently projects an image in accordance with the synchronization signal.
- the transmitter 150 is connected to the projector 120 by, for example, a synchronization signal line.
- the synchronization signal output unit 224 causes the transmitter 150 to blink for a predetermined time in accordance with the synchronization signal.
- the synchronous signal output unit 224 blinks the transmitter 150 in a pattern such that the transmitter 150 is turned on when the projector is projected and the transmitter 150 is turned off when the projector 220 is not projected.
- the projection timing of the projector 220 and the lighting timing of the transmitter 150 may be opposite to each other.
- the blinking time (time when a signal is transmitted from the transmitter 150) is determined based on the time required to synchronize the projection timing of the projector 220 with the shielding timing of the shutter device 130. For example, the blinking time is a time of 1 refresh period or more and 10 refresh periods or less.
- the camera 240 does not have the synchronization control unit 142 and the synchronization signal output unit 143 as compared with the configuration of the first embodiment.
- the exposure time setting unit 141, the exposure control unit 144, and the recording unit 146 have known structures.
- a general-purpose machine is used for the camera 240.
- the configuration of the shutter device 130 is the same as that of the first embodiment.
- the shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal.
- the shutter member 135 is arranged, for example, on the optical axis of the light incident on the camera 240.
- the shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131.
- the shutter control signal is, for example, a signal having information on the shielding time and the shielding cycle corresponding to the lighting time and the lighting cycle of the transmitter 150.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal.
- the shutter device 130 dynamically changes the shielding time for shielding the light incident on the camera 240 according to the projection time of the projector 220.
- FIG. 15 is a flowchart showing an example of the photographing method of the present embodiment.
- step S41 the 3D model storage unit 111 reads and stores the 3D model of the studio ST from the information input to the information processing device 110.
- step S42 the parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 220 and the position / orientation information of the projector 220 in the 3D model from the input information.
- step S43 the receiving unit 131 receives the signal transmitted from the transmitter 150.
- the shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131.
- the shutter control unit 134 synchronizes the shielding timing of the shutter member 135 with the projection timing of the projector 220 based on the shutter control signal.
- step S44 the display content generation unit 113 generates projection content including information that supports the performance of the performer AC.
- the corrected image generation unit 114 geometrically corrects the projection content using the internal parameters of the 3D model and the projector 220 and the position / orientation information of the projector 220 in the 3D model, and generates a corrected image.
- step S45 the projector 120 projects the corrected image onto the studio ST.
- the camera 240 photographs the performer performing in the studio ST.
- the light incident on the camera 240 is intermittently shielded by the shutter device 130 synchronized with the projector 220 in accordance with the projection timing of the projector 220. As a result, it is possible to prevent the projected image from being reflected in the captured image of the camera 240.
- step S46 the projection time setting unit 215 determines whether or not the projection time has been changed.
- the projection time setting unit 215 determines that the projection time has been changed, for example, when the user manually sets the projection time.
- step S46 If it is determined in step S46 that the projection time has been changed (step S46: Yes), the process returns to step S43.
- step S46 determines whether or not to end the projection. If it is determined in step S47 that the projection has been completed (step S47: Yes), the projector 220 ends the projection. If it is not determined in step S47 that the projection has been completed (step S47: No), the process returns to step S44.
- 16 and 17 are timing charts showing an example of the operation of the projector 220, the transmitter 150, the shutter device 130, and the camera 240.
- the shutter device 130 is in the shielded state (ON).
- the shutter device 130 is in the non-shielded state (OFF).
- the projector 220 projects an image at a refresh rate higher than the frame rate of the camera 240, more preferably at a refresh rate that is at least twice the frame rate.
- the shutter device 130 shields the light incident on the camera 240 at the timing when the projection of the projector 220 and the shooting of the camera 240 overlap.
- the light incident on the camera 240 is intermittently shielded by the shutter device 130 in accordance with the projection timing of the projector 220.
- the transmitter 150 is turned on during the projection period and turned off during the non-projection period.
- FIG. 16 is a timing chart when the projection time and the non-projection time are equal.
- the projection time of the projector 220 and the non-shielding time of the shutter device 130 are equal. Therefore, a bright image is taken without significantly impairing the brightness of the projected image.
- FIG. 17 is a timing chart when the non-projection time is longer than the projection time. In the example of FIG. 17, the projected image is dark, but the shielding time by the camera shutter is short, so that the brightness of the captured image is brighter than that of the example of FIG.
- FIG. 18 is a diagram showing the relationship between the brightness of the captured image and the brightness of the projected image.
- the brightness of the captured image and the brightness of the projected image change depending on the projection time of the projector 220.
- the longer the projection time the brighter the image will be projected.
- the longer the projection time the longer the shielding time by the shutter device 130. Therefore, the captured image becomes dark. Therefore, there is a trade-off between the brightness of the captured image and the brightness of the projected image.
- the user can manually set the projection time based on the shooting phase, the studio ST environment, and the like, taking these trade-offs into consideration. Further, the projection time information set by the projection time setting unit 215 can be output to the video output unit 221, and the brightness of the projected image can be corrected by the video output unit 221.
- the shutter device 130 dynamically changes the shielding time for shielding the light incident on the camera 240 according to the projection time of the projector 220.
- the projected light is suppressed from being reflected in the image of the camera 240 even if the projection time of the projector 220 changes.
- the refresh rate of the projector 220 is higher than the frame rate of the camera 240, for example.
- the photographing system 3 has, for example, a transmitter 150.
- the transmitter 150 transmits, for example, a signal indicating the projection timing of the projector 220.
- the shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal.
- the degree of freedom in arranging the projector 220 and the shutter device 130 is increased.
- FIG. 19 is a diagram showing a main part of the photographing system 4 of the fourth embodiment.
- the difference between the third embodiment and the third embodiment is that the projector 226 is different from the third embodiment during the period from the change of the projection timing of the projector 226 to the synchronization of the shielding timing of the shutter device 230 with the projection timing of the changed projector 226. The point where the projection of light by is stopped.
- the differences from the third embodiment will be mainly described.
- the synchronization control unit 227 generates, for example, a projection stop signal of the projector 226 based on the projection time information output from the projection time setting unit 215. For example, when the fluctuation of the projection time is larger than the threshold value, the synchronization control unit 227 outputs the projection stop signal to the video output unit 228 for a predetermined time after the transmitter 150 starts transmitting the signal. The synchronization control unit 227 does not output a projection stop signal to the video output unit 228, for example, when the fluctuation of the projection time is within the threshold value.
- the video output unit 228 stops the output of the projected video signal to the projection unit 122 for a predetermined time after the transmitter 150 starts transmitting the signal, for example, based on the projection stop signal.
- the time at which the signal is transmitted from the transmitter 150 is set based on the time required to synchronize the projector 226 and the shutter device 230. Therefore, the projection of light by the projector 226 is stopped during the period from when the projection timing of the projector 226 is changed until the shielding timing of the shutter device 230 is synchronized with the projection timing of the changed projector 226.
- the projection stop signal is not output to the video output unit 228. Therefore, the shielding time is not changed.
- the shutter control signal generation unit 233 sets, for example, the shielding time of the shutter device 230 in one refresh period of the projector 226 to be longer than the projection time of the projector 226.
- the shielding period of the shutter device 230 is set so that the shielding start timing is earlier than the projection start timing and the shielding end timing is later than the projection end timing in one refresh period of the projector 226.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the projection time.
- FIG. 20 is a timing chart showing an example of the operation of the projector 266, the transmitter 150, the shutter device 230, and the camera 240.
- a buffer period of ⁇ s is provided on each of the shielding start side and the shielding end side.
- the shielding start timing is ⁇ s earlier than the projection start timing
- the shielding end timing is ⁇ s later than the projection end timing.
- the synchronization control unit 227 uses, for example, the buffer period as a threshold value as a reference for determining the projection stop.
- the synchronization control unit 227 generates a projection stop signal, for example, when the projection time fluctuates beyond the buffer period.
- the synchronization control unit 227 does not generate a projection stop signal, for example, when the fluctuation of the projection time falls within the buffer period.
- FIG. 21 is a flowchart illustrating an example of the photographing method of the present embodiment.
- step S51 the projector 226 projects an image supporting the performance of the performer AC on the studio ST.
- step S52 the synchronization control unit 227 determines whether or not the projection time of the projector 226 has been changed based on the projection time information output from the projection time setting unit 215. If it is not determined in step S52 that the projection time has been changed (step S52: No), step S52 is repeated until the projection time is changed.
- step S52 If it is determined in step S52 that the projection time has been changed (step S52: Yes), the process proceeds to step S53.
- step S53 the synchronization control unit 227 determines whether or not the fluctuation of the projection time exceeds the threshold value.
- step S53 If it is determined in step S53 that the fluctuation of the projection time exceeds the threshold value (step S53: Yes), the process proceeds to step S54.
- step S54 the synchronization control unit 227 outputs a projection stop signal to the video output unit 228.
- the projector 226 stops the projection of the image based on the projection stop signal.
- step S55 the shutter control signal generation unit 233 generates a shutter control signal based on the projection timing information detected by the reception unit 131.
- the shutter control signal generation unit 233 sets the shielding time of the shutter device 230 longer than the projection time of the projector 226.
- the shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the projection time.
- step S53 If it is not determined in step S53 that the fluctuation of the projection time exceeds the threshold value (step S53: No), the process proceeds to step S55.
- step S56 the camera 240 determines whether or not to end the shooting. If it is determined in step S56 that the shooting is finished (step S56: Yes), the camera 240 finishes the shooting. If it is not determined in step S56 that the shooting is finished (step S56: No), the process returns to step S51.
- the projection of light by the projector 226 is stopped during the period from the change of the projection timing of the projector 226 to the synchronization of the shielding timing of the shutter device 230 with the projection timing of the changed projector 226. Will be done.
- the projected light is suppressed from being reflected in the image of the camera 240 during the adjustment period of the shielding timing.
- the shielding time is not changed.
- the shielding time of the shutter device 230 in one refresh period of the projector 226 is longer than, for example, the projection time of the projector 226.
- the projected image is not reflected in the captured image.
- the buffer period in the shielding period even if there is a lag in the processing of various devices, it is possible to suppress the projection image from being reflected in the captured image due to the lag.
- the projected light is reflected in the image of the camera 240 during the period from the start of the shutter device 230 to the end of the shielding and the period from the start of the projector 226 displaying the image on one screen to the end of the display. Is suppressed.
- the timing of turning on and off the transmitter 150 and the timing of shielding and transmitting through the shutter device 130 coincide with each other.
- a buffer period may be provided in the shielding period of the shutter device 130.
- the shielding time of the shutter device 130 in one frame period of the camera 140 is longer than the exposure time of the camera 140. According to this configuration, even if there is a lag in the processing of various devices, it is possible to prevent the projected image from being reflected in the captured image due to the lag.
- A Shooting camera There is a lag of operation from when the camera shutter starts to close until the light is completely blocked, or vice versa.
- B Projector When a laser projector is used, there is a lag from image projection by the raster scan method or image projection to non-projection.
- C Shutter device When using a liquid crystal shutter, there is a lag in operation from the start of shielding until the entire screen is shielded, or vice versa.
- the following measurement is performed.
- a photodiode is installed on the light emitting side of the shutter device 130. Then, the intensity of the projected light of the projector 120 is measured through the shutter device.
- FIG. 22 is a diagram showing an example of the measurement result of the light intensity measured through the shutter device.
- the liquid crystal shutter is used as the shutter device, but the shutter device is not limited to the liquid crystal shutter.
- a rotating wheel provided with a light transmitting window may be used to switch between a light transmitting state and a light blocking state. By changing the rotation speed of the rotating wheel, the shielding cycle is changed. The shielding time is changed by providing a mechanism capable of continuously changing the size of the light transmitting window.
- the IR emitter is used as the transmitter 150, but the transmitter 150 is not limited to the IR emitter. Synchronization may be performed by the shutter device communicating with the camera or projector by wire or wirelessly.
- Described shooting system (5) The imaging system according to (4) above, wherein the shielding time is not changed when the fluctuation of the exposure time is within the threshold value. (6) The imaging system according to (5), wherein the shielding time of the shutter device in one frame period of the camera is longer than the exposure time of the camera. (7) The imaging system according to (1), wherein the shutter device dynamically changes the shielding time for shielding light incident on the camera according to the projection time of the projector. (8) The imaging system according to (7), wherein the refresh rate of the projector is larger than the frame rate of the camera. (9) It has a transmitter that transmits a signal indicating the projection timing of the projector.
- a shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
- a method of shooting that is performed by a computer.
- a shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Shutters For Cameras (AREA)
- Accessories Of Cameras (AREA)
Abstract
A photography system (1) that includes a camera (140), a projector (120), and a shutter device (130). The shutter device (130) is synchronized with the camera (140) or the projector (120) and blocks light that is projected from the projector (120) and would enter the camera (140).
Description
本発明は、撮影システム、撮影方法およびプログラムに関する。
The present invention relates to a photographing system, a photographing method and a program.
映画やドラマのリハーサルでは、演者の立ち位置や移動経路などがテープでマーキングされる。テープは撮影シーンごとに張り替えられる。そのため、テープによるマーキングをプロジェクションマッピングによって代替することが検討されている。演者の負担を減らすために、リハーサルだけでなく本番の撮影でも移動経路などの情報を投射することも考えられる。この場合、撮影画像に投射光が映り込まないようにする必要がある。投射光が撮影画像に映り込まないようにする技術としては、特許文献1の技術が知られている。特許文献1では、カメラの撮影周期とプロジェクタの投射周期とを同期させている。
In movie and drama rehearsals, the performer's standing position and movement route are marked with tape. The tape is changed for each shooting scene. Therefore, it is being considered to replace the marking with tape by projection mapping. In order to reduce the burden on the performer, it is conceivable to project information such as the movement route not only during rehearsals but also during actual shooting. In this case, it is necessary to prevent the projected light from being reflected in the captured image. The technique of Patent Document 1 is known as a technique for preventing the projected light from being reflected in the captured image. In Patent Document 1, the shooting cycle of the camera and the projection cycle of the projector are synchronized.
しかしながら、上記の従来技術では、カメラとプロジェクタの双方に、同期処理を行うための専用の構造を作り込む必要がある。そのため、カメラとプロジェクタを汎用機で代替することができず、開発コストが高くなる。
However, in the above-mentioned conventional technology, it is necessary to create a dedicated structure for performing synchronization processing in both the camera and the projector. Therefore, the camera and the projector cannot be replaced by a general-purpose machine, and the development cost becomes high.
そこで、本開示では、演者の負担を軽減しつつ低コストで撮影を行うことができる撮影システム、撮影方法およびプログラムを提案する。
Therefore, in this disclosure, we propose a shooting system, shooting method, and program that can shoot at low cost while reducing the burden on the performer.
本開示によれば、カメラと、プロジェクタと、前記カメラまたは前記プロジェクタと同期し、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽するシャッタ装置と、を有する撮影システムが提供される。また、本開示によれば、前記撮影システムの情報処理がコンピュータにより実行される撮影方法、および、前記撮影システムの情報処理をコンピュータに実現させるプログラムが提供される。
According to the present disclosure, there is provided a photographing system including a camera, a projector, and a shutter device that synchronizes with the camera or the projector and blocks light projected from the projector and incident on the camera. Further, according to the present disclosure, there is provided a photographing method in which the information processing of the photographing system is executed by a computer, and a program for realizing the information processing of the photographing system in the computer.
以下に、本開示の実施形態について図面に基づいて詳細に説明する。以下の各実施形態において、同一の部位には同一の符号を付することにより重複する説明を省略する。
Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each of the following embodiments, the same parts are designated by the same reference numerals, so that duplicate description will be omitted.
なお、説明は以下の順序で行われる。
[1.第1実施形態]
[1-1.撮影システムの構成]
[1-2.撮影方法]
[1-3.効果]
[2.第2実施形態]
[2-1.撮影システムの構成]
[2-2.撮影方法]
[2-3.効果]
[3.第3実施形態]
[3-1.撮影システムの構成]
[3-2.撮影方法]
[3-3.効果]
[4.第4実施形態]
[4-1.撮影システムの構成]
[4-2.撮影方法]
[4-3.効果]
[5.変形例] The explanation will be given in the following order.
[1. First Embodiment]
[1-1. Shooting system configuration]
[1-2. Shooting method]
[1-3. effect]
[2. Second Embodiment]
[2-1. Shooting system configuration]
[2-2. Shooting method]
[2-3. effect]
[3. Third Embodiment]
[3-1. Shooting system configuration]
[3-2. Shooting method]
[3-3. effect]
[4. Fourth Embodiment]
[4-1. Shooting system configuration]
[4-2. Shooting method]
[4-3. effect]
[5. Modification example]
[1.第1実施形態]
[1-1.撮影システムの構成]
[1-2.撮影方法]
[1-3.効果]
[2.第2実施形態]
[2-1.撮影システムの構成]
[2-2.撮影方法]
[2-3.効果]
[3.第3実施形態]
[3-1.撮影システムの構成]
[3-2.撮影方法]
[3-3.効果]
[4.第4実施形態]
[4-1.撮影システムの構成]
[4-2.撮影方法]
[4-3.効果]
[5.変形例] The explanation will be given in the following order.
[1. First Embodiment]
[1-1. Shooting system configuration]
[1-2. Shooting method]
[1-3. effect]
[2. Second Embodiment]
[2-1. Shooting system configuration]
[2-2. Shooting method]
[2-3. effect]
[3. Third Embodiment]
[3-1. Shooting system configuration]
[3-2. Shooting method]
[3-3. effect]
[4. Fourth Embodiment]
[4-1. Shooting system configuration]
[4-2. Shooting method]
[4-3. effect]
[5. Modification example]
[1.第1実施形態]
[1-1.撮影システムの構成]
図1は、第1実施形態の撮影システム1の概略図である。 [1. First Embodiment]
[1-1. Shooting system configuration]
FIG. 1 is a schematic view of the photographing system 1 of the first embodiment.
[1-1.撮影システムの構成]
図1は、第1実施形態の撮影システム1の概略図である。 [1. First Embodiment]
[1-1. Shooting system configuration]
FIG. 1 is a schematic view of the photographing system 1 of the first embodiment.
撮影システム1は、例えば、情報処理装置110と、プロジェクタ120と、シャッタ装置130と、カメラ140と、送信機150と、を有する。
The photographing system 1 includes, for example, an information processing device 110, a projector 120, a shutter device 130, a camera 140, and a transmitter 150.
情報処理装置110は、プロジェクタ120によって投射される映像を生成する。情報処理装置110は、例えば、3Dモデル記憶部111と、パラメータ記憶部112と、表示コンテンツ生成部113と、補正映像生成部114と、を有する。
The information processing device 110 generates an image projected by the projector 120. The information processing device 110 includes, for example, a 3D model storage unit 111, a parameter storage unit 112, a display content generation unit 113, and a correction video generation unit 114.
3Dモデル記憶部111は、例えば、情報処理装置110に入力された情報から、スタジオSTの3Dモデルを読み込み記憶する。パラメータ記憶部112は、例えば、プロジェクタ120の内部パラメータおよび3Dモデル内のプロジェクタ120の位置姿勢情報を入力情報から読み込み記憶する。
The 3D model storage unit 111 reads and stores, for example, the 3D model of the studio ST from the information input to the information processing device 110. The parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 120 and the position / orientation information of the projector 120 in the 3D model from the input information.
表示コンテンツ生成部113は、例えば、スタジオSTに投射されるコンテンツを生成する。コンテンツは、演者ACの演技をサポートする情報を含む。コンテンツは、例えば、演者ACの立ち位置、演者ACの移動経路を示す導線、および、演者ACの周囲に存在するCGキャラクタなどを含む。
The display content generation unit 113 generates, for example, the content projected on the studio ST. The content includes information that supports the performance of the performer AC. The content includes, for example, the standing position of the performer AC, a conductor indicating the movement path of the performer AC, and a CG character existing around the performer AC.
補正映像生成部114は、例えば、ユーザが編集したコンテンツ、3Dモデルおよびプロジェクタ120の内部パラメータおよび3Dモデル中のプロジェクタ120の位置姿勢情報を用いて、コンテンツを幾何補正し、補正映像を生成する。補正映像生成部114は、補正映像の映像ソースをプロジェクタ120に送信する。
The corrected video generation unit 114 geometrically corrects the content using, for example, the content edited by the user, the internal parameters of the 3D model and the projector 120, and the position / orientation information of the projector 120 in the 3D model, and generates the corrected video. The corrected video generation unit 114 transmits the video source of the corrected video to the projector 120.
情報処理装置110は、例えば、プロセッサとメモリとで構成されるコンピュータである。情報処理装置110のメモリには、RAM(Random Access Memory)およびROM(Read Only Memory)が含まれる。情報処理装置110は、図示略の情報処理プログラムを実行することにより、表示コンテンツ生成部113および補正映像生成部114として機能する。
The information processing device 110 is, for example, a computer composed of a processor and a memory. The memory of the information processing apparatus 110 includes a RAM (Random Access Memory) and a ROM (Read Only Memory). The information processing device 110 functions as a display content generation unit 113 and a corrected video generation unit 114 by executing an information processing program (not shown).
プロジェクタ120は、例えば、映像出力部121と、投射部122と、を有する。
The projector 120 has, for example, a video output unit 121 and a projection unit 122.
映像出力部121は、プロジェクタ120内のプロセッサである。映像出力部121は、補正映像生成部114から受け取った映像ソースを投射映像信号に変換して投射部122に出力する。
The video output unit 121 is a processor in the projector 120. The video output unit 121 converts the video source received from the corrected video generation unit 114 into a projected video signal and outputs it to the projection unit 122.
投射部122は、映像ソースに基づく映像をスタジオATの目的とする場所に投射する。スタジオSTには、3Dモデルおよびプロジェクタ120の位置姿勢情報に応じて歪み補正されたコンテンツの映像が投射される。投射部122は、所定のリフレッシュレートで映像を投射する。投射部122としては、3LCD(Liquid Crystal Display)方式、LCOS(Liquid Crystal on Silicon)方式およびDLP(Digital Light Processing;登録商標)方式などの公知の投射方式が採用される。
The projection unit 122 projects an image based on the image source to a target location of the studio AT. The image of the content corrected for distortion is projected on the studio ST according to the position / orientation information of the 3D model and the projector 120. The projection unit 122 projects an image at a predetermined refresh rate. As the projection unit 122, known projection methods such as a 3LCD (Liquid Crystal Display) method, an LCOS (Liquid Crystal on Silicon) method, and a DLP (Digital Light Processing; registered trademark) method are adopted.
映像出力部121および投射部122は、公知の構造を有する。プロジェクタ120には、汎用機が用いられる。
The video output unit 121 and the projection unit 122 have known structures. A general-purpose machine is used for the projector 120.
カメラ140は、スタジオSTで演技する演者ACを撮影する。カメラ140は、所定のフレームレートで撮影を行う。カメラ140は、例えば、露光時間設定部141と、同期制御部142と、同期信号出力部143と、露光制御部144と、撮像部145と、記録部146と、を有する。
Camera 140 captures the performer AC acting in the studio ST. The camera 140 shoots at a predetermined frame rate. The camera 140 includes, for example, an exposure time setting unit 141, a synchronization control unit 142, a synchronization signal output unit 143, an exposure control unit 144, an imaging unit 145, and a recording unit 146.
露光時間設定部141は、カメラ140のフレームレートおよび1フレーム期間内のカメラ140の露光時間(シャッタスピード)を設定する。フレームレートは、例えば、ユーザが入力した設定値に設定される。露光時間は、例えば、手動または自動で設定される。手動モードでは、露光時間は、ユーザが入力した設定値に設定される。自動モードでは、露光時間は、例えば、撮影環境の明るさに基づいて自動で設定される。露光時間設定部141は、例えば、フレームレートおよび露光時間の少なくとも1つが変更されることにより露光タイミングが変更された場合に、変更後の露光タイミングに関する情報(フレームレートおよび露光時間)を同期制御部142に出力する。
The exposure time setting unit 141 sets the frame rate of the camera 140 and the exposure time (shutter speed) of the camera 140 within one frame period. The frame rate is set to, for example, a setting value input by the user. The exposure time is set, for example, manually or automatically. In the manual mode, the exposure time is set to a set value entered by the user. In the automatic mode, the exposure time is automatically set based on, for example, the brightness of the shooting environment. The exposure time setting unit 141 synchronously controls information (frame rate and exposure time) regarding the changed exposure timing when the exposure timing is changed by changing at least one of the frame rate and the exposure time, for example. Output to 142.
同期制御部142は、露光時間に基づいて同期信号を生成する。同期制御部142は、同期信号を同期信号出力部143および露光制御部144に出力する。
The synchronization control unit 142 generates a synchronization signal based on the exposure time. The synchronization control unit 142 outputs a synchronization signal to the synchronization signal output unit 143 and the exposure control unit 144.
同期信号出力部143は、同期信号に基づいて、カメラ140の露光タイミングを示す信号を送信機150から送信させる。露光制御部144は、同期信号に合わせてカメラシャッタを開閉させる。カメラシャッタは、例えば、カメラ140の内部に設けられたフォーカルプレーンシャッタまたはレンズシャッタである。カメラシャッタは、カメラ140の撮像素子に対して、撮影時のみ光があたるように、カメラ140の露光期間中のみ開き、それ以外の期間は光を遮蔽する。
The synchronization signal output unit 143 causes the transmitter 150 to transmit a signal indicating the exposure timing of the camera 140 based on the synchronization signal. The exposure control unit 144 opens and closes the camera shutter in accordance with the synchronization signal. The camera shutter is, for example, a focal plane shutter or a lens shutter provided inside the camera 140. The camera shutter opens only during the exposure period of the camera 140 so that the image sensor of the camera 140 is exposed to light only during shooting, and shields the light during other periods.
送信機150は、例えば、赤外線信号を送信するIR(Infrared)エミッタである。送信機150は、例えば、同期信号線によってカメラ140と接続される。
The transmitter 150 is, for example, an IR (Infrared) emitter that transmits an infrared signal. The transmitter 150 is connected to the camera 140 by, for example, a synchronization signal line.
同期信号出力部143は、例えば、同期信号に合わせて送信機150を所定の時間だけ点滅させる。同期信号出力部143は、例えば、カメラ140の露光時(カメラシャッタが開いているとき)は送信機150が点灯し、カメラの非露光時(カメラシャッタが閉じているとき)は送信機150が消灯するようなパターンで送信機150を点滅させる。カメラ140の露光タイミングと送信機150の点灯タイミングはこれとは逆でもよい。
The synchronization signal output unit 143 blinks the transmitter 150 for a predetermined time in accordance with the synchronization signal, for example. In the synchronous signal output unit 143, for example, the transmitter 150 is lit when the camera 140 is exposed (when the camera shutter is open), and the transmitter 150 is turned on when the camera is not exposed (when the camera shutter is closed). The transmitter 150 is blinked in a pattern that turns off the light. The exposure timing of the camera 140 and the lighting timing of the transmitter 150 may be opposite to each other.
点滅時間(送信機150から信号が送信される時間)は、カメラ140の露光タイミングとシャッタ装置130の遮蔽タイミングとを同期させるのに必要な時間に基づいて決定される。例えば、点滅時間は、1フレーム期間以上で且つ10フレーム期間以下の時間である。
The blinking time (time when a signal is transmitted from the transmitter 150) is determined based on the time required to synchronize the exposure timing of the camera 140 and the shielding timing of the shutter device 130. For example, the blinking time is a time of 1 frame period or more and 10 frame period or less.
撮像部145は、カメラシャッタの開閉タイミングに合わせて所定のフレームレートで間欠的に画像を撮影する。記録部146は、撮像部145で撮影された画像を記録する。
The imaging unit 145 intermittently captures an image at a predetermined frame rate according to the opening / closing timing of the camera shutter. The recording unit 146 records an image taken by the imaging unit 145.
シャッタ装置130は、プロジェクタ120から投射されカメラ140へ入射する光を遮蔽する。シャッタ装置130は、例えば、送信機150から送信された信号を受信し、この信号に基づいて遮蔽時間を制御する。シャッタ装置130は、カメラ140と同期し、カメラ140の露光タイミングに合わせて、プロジェクタ120から投射される光を遮蔽する。
The shutter device 130 shields the light projected from the projector 120 and incident on the camera 140. The shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal. The shutter device 130 synchronizes with the camera 140 and shields the light projected from the projector 120 in accordance with the exposure timing of the camera 140.
シャッタ装置130は、例えば、受信部131と、記憶部132と、シャッタ制御信号生成部133と、シャッタ制御部134と、シャッタ部材135と、を有する。
The shutter device 130 includes, for example, a receiving unit 131, a storage unit 132, a shutter control signal generation unit 133, a shutter control unit 134, and a shutter member 135.
受信部131は、送信機150から送信された信号を受信する。受信部131は、例えば、受信した光の光量を2値化処理して、送信機150の点灯状態と非点灯状態とを検出する。受信部131は、受信した信号に基づいて、露光タイミングを検出する。例えば、受信部131は、送信機150の点灯時間および点灯周期に基づいて、カメラ140の露光時間および露光周期(フレームレート)を検出する。受信部131は、カメラ140の露光タイミングを示す情報をシャッタ制御信号生成部133に出力する。
The receiving unit 131 receives the signal transmitted from the transmitter 150. For example, the receiving unit 131 binarizes the amount of received light to detect whether the transmitter 150 is lit or not lit. The receiving unit 131 detects the exposure timing based on the received signal. For example, the receiving unit 131 detects the exposure time and the exposure cycle (frame rate) of the camera 140 based on the lighting time and the lighting cycle of the transmitter 150. The receiving unit 131 outputs information indicating the exposure timing of the camera 140 to the shutter control signal generation unit 133.
シャッタ制御信号生成部133は、受信部131で受信した信号に基づいて、シャッタ制御信号を生成する。シャッタ制御信号は、例えば、送信機150の点灯時間および点灯周期に対応する遮蔽時間および遮蔽周期の情報を有する信号である。シャッタ制御部134は、シャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。これにより、シャッタ装置130は、プロジェクタ120から投射される光を遮蔽する遮蔽時間をカメラ140の露光時間に合わせて動的に変更する。
The shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131. The shutter control signal is, for example, a signal having information on the shielding time and the shielding cycle corresponding to the lighting time and the lighting cycle of the transmitter 150. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal. As a result, the shutter device 130 dynamically changes the shielding time for shielding the light projected from the projector 120 according to the exposure time of the camera 140.
シャッタ部材135は、例えば、電圧によって可視光の透過率が変化する液晶シャッタである。シャッタ部材135は、例えば、投射部122から投射される光の光軸上に配置される。シャッタ部材135は、例えば、電圧非印加時に投射部122から投射された光を透過する。シャッタ部材135は、例えば、閾値以上の電圧が印加されたときに投射部122から投射された光を遮蔽する。
The shutter member 135 is, for example, a liquid crystal shutter whose visible light transmittance changes depending on the voltage. The shutter member 135 is arranged, for example, on the optical axis of the light projected from the projection unit 122. The shutter member 135 transmits, for example, the light projected from the projection unit 122 when no voltage is applied. For example, the shutter member 135 shields the light projected from the projection unit 122 when a voltage equal to or higher than the threshold value is applied.
シャッタ装置130は、プロセッサとメモリとで構成されるコンピュータを含む。記憶部132は、シャッタ装置130の処理をコンピュータに実行させるプログラムPGを記憶する。シャッタ装置130は、プログラムPGを実行することにより、受信部131、記憶部132、シャッタ制御信号生成部133およびシャッタ制御部134として機能する。
The shutter device 130 includes a computer composed of a processor and a memory. The storage unit 132 stores the program PG that causes the computer to execute the processing of the shutter device 130. The shutter device 130 functions as a receiving unit 131, a storage unit 132, a shutter control signal generation unit 133, and a shutter control unit 134 by executing the program PG.
記憶部132は、例えば、半導体記憶媒体および磁気記憶媒体などの任意の非一過的な記憶媒体を含む。記憶部132は、例えば、光ディスク、光磁気ディスクまたはフラッシュメモリを含んで構成される。プログラムは、例えば、コンピュータにより読み取り可能な非一過的な記憶媒体に記憶されている。
The storage unit 132 includes any non-transient storage medium such as a semiconductor storage medium and a magnetic storage medium. The storage unit 132 includes, for example, an optical disk, a magneto-optical disk, or a flash memory. The program is stored, for example, in a non-transient storage medium that can be read by a computer.
[1-2.撮影方法]
図2は、本実施形態の撮影方法の一例を説明するフローチャートである。 [1-2. Shooting method]
FIG. 2 is a flowchart illustrating an example of the photographing method of the present embodiment.
図2は、本実施形態の撮影方法の一例を説明するフローチャートである。 [1-2. Shooting method]
FIG. 2 is a flowchart illustrating an example of the photographing method of the present embodiment.
ステップS1において、同期制御部142は、露光時間設定部141で設定された露光時間に基づいて、送信機150の点滅パターンを決定する。
In step S1, the synchronization control unit 142 determines the blinking pattern of the transmitter 150 based on the exposure time set by the exposure time setting unit 141.
ステップS2において、送信機150は、同期制御部142で決定された点滅パターンで点滅を開始する。送信機150は、光の点滅を用いた信号を、カメラ140の露光タイミングを示す信号として送信する。
In step S2, the transmitter 150 starts blinking in the blinking pattern determined by the synchronization control unit 142. The transmitter 150 transmits a signal using blinking light as a signal indicating the exposure timing of the camera 140.
ステップS3において、受信部131は、送信機150から送信された信号を受信する。シャッタ制御信号生成部133は、受信部131で受信した信号に基づいて、シャッタ制御信号を生成する。シャッタ制御部134は、シャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングをカメラ140の露光タイミングと同期させる。
In step S3, the receiving unit 131 receives the signal transmitted from the transmitter 150. The shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131. The shutter control unit 134 synchronizes the shielding timing of the shutter member 135 with the exposure timing of the camera 140 based on the shutter control signal.
ステップS4において、露光時間設定部141は、露光時間が変更されたか否かを判定する。露光時間設定部141は、例えば、ユーザが手動で露光時間を設定した場合、または、撮影環境の明るさの変化に基づいて露光時間を自動で変更された場合に、露光時間が変更されたと判定する。
In step S4, the exposure time setting unit 141 determines whether or not the exposure time has been changed. The exposure time setting unit 141 determines that the exposure time has been changed, for example, when the user manually sets the exposure time or when the exposure time is automatically changed based on the change in the brightness of the shooting environment. do.
ステップS4において露光時間が変更されたと判定された場合には(ステップS4:Yes)、ステップS1に戻る。
If it is determined in step S4 that the exposure time has been changed (step S4: Yes), the process returns to step S1.
ステップS4において露光時間が変更されていないと判定された場合には(ステップS4:No)、ステップS5に進む。ステップS5において、カメラ140は、撮影を終了するか否かを判定する。カメラ140は、例えば、カメラ140に設けられた図示略の撮影終了ボタンが操作された場合に、撮影が終了されたと判定する。
If it is determined in step S4 that the exposure time has not been changed (step S4: No), the process proceeds to step S5. In step S5, the camera 140 determines whether or not to end the shooting. The camera 140 determines that the shooting has been completed, for example, when the shooting end button (not shown) provided on the camera 140 is operated.
ステップS5において撮影が終了すると判定された場合には(ステップS5:Yes)、カメラ140は撮影を終了する。ステップS5において撮影が終了すると判定されない場合には(ステップS5:No)、ステップS4に戻る。
If it is determined in step S5 that the shooting is finished (step S5: Yes), the camera 140 ends the shooting. If it is not determined in step S5 that the shooting is completed (step S5: No), the process returns to step S4.
図3は、カメラ140とシャッタ装置130とを同期させる処理の一例を説明するフローチャートである。
FIG. 3 is a flowchart illustrating an example of a process of synchronizing the camera 140 and the shutter device 130.
ステップS11において、受信部131は、送信機150が点滅を開始したか否かを判定する。送信機150は、露光時間が変更された場合に、露光時間に応じた所定の点灯時間および点灯周期を有する点滅パターンで所定の時間だけ点滅する。例えば、カメラ140のフレームレートが60fps(frame per sec)で露光時間が4ミリ秒である場合、送信機150は、1/60秒のうち4ミリ秒だけ点灯し、残りの時間(= 約12.7ミリ秒)は消灯するように点灯と消灯とを繰り返す。受信部131は、送信機150の最初の点灯を検出したときに点滅が開始したと判定する。受信部131は、最初の点灯が検出され始めたタイミングを点滅開始タイミングとして検出する。
In step S11, the receiving unit 131 determines whether or not the transmitter 150 has started blinking. When the exposure time is changed, the transmitter 150 blinks for a predetermined time in a blinking pattern having a predetermined lighting time and a lighting cycle according to the exposure time. For example, when the frame rate of the camera 140 is 60 fps (frame per sec) and the exposure time is 4 milliseconds, the transmitter 150 lights up for 4 milliseconds out of 1/60 seconds, and the remaining time (= about 12). .7 milliseconds) repeats turning on and off so that it goes out. The receiving unit 131 determines that the blinking has started when the first lighting of the transmitter 150 is detected. The receiving unit 131 detects the timing at which the first lighting starts to be detected as the blinking start timing.
ステップS11において点滅が開始されたと判定された場合(ステップS11:Yes)、ステップS12に進む。ステップS12において、受信部131は、点灯開始タイミングからの1周期分の点灯時間の計測を開始する。ステップS11において点滅が開始されたと判定されなかった場合(ステップS11:No)、点滅が開始されるまでステップS1を繰り返す。
If it is determined in step S11 that blinking has started (step S11: Yes), the process proceeds to step S12. In step S12, the receiving unit 131 starts measuring the lighting time for one cycle from the lighting start timing. If it is not determined in step S11 that the blinking has started (step S11: No), step S1 is repeated until the blinking starts.
ステップS13おいて、受信部131は、1周期分の点灯が終了したか否かを判定する。
In step S13, the receiving unit 131 determines whether or not the lighting for one cycle has been completed.
ステップS13において1周期分の点灯が終了したと判定された場合(ステップS13:Yes)、受信部131は、1周期分の点灯が終了したタイミングを点灯終了タイミング(消灯開始タイミング)として検出する。そして、ステップS14において、点灯時間の計測を終了する。ステップS13において1周期分の点灯が終了したと判定されなかった場合(ステップS13:No)、点灯が終了するまでステップS13を繰り返す。
When it is determined in step S13 that the lighting for one cycle is completed (step S13: Yes), the receiving unit 131 detects the timing when the lighting for one cycle is completed as the lighting end timing (lighting start timing). Then, in step S14, the measurement of the lighting time is completed. If it is not determined in step S13 that the lighting for one cycle is completed (step S13: No), step S13 is repeated until the lighting is completed.
ステップS15において、受信部131は、1周期分の消灯時間の計測を開始する。そして、ステップS16において、受信部131は、消灯時間経過後の次周期の点灯開始タイミングを検出したか否かを判定する。ステップS16において次周期の点灯開始タイミングを検出したと判定された場合(ステップS16:Yes)、1周期分の消灯時間の計測を終了する。受信部131は、次周期の点灯が開始したタイミングを1周期分の消灯終了タイミングとして検出する。ステップS16において次周期の点灯開始タイミングを検出したと判定されなかった場合(ステップS16:No)、次周期の点灯開始タイミングが検出されるまでステップS16を繰り返す。
In step S15, the receiving unit 131 starts measuring the extinguishing time for one cycle. Then, in step S16, the receiving unit 131 determines whether or not the lighting start timing of the next cycle after the elapse of the extinguishing time has been detected. When it is determined in step S16 that the lighting start timing of the next cycle is detected (step S16: Yes), the measurement of the extinguishing time for one cycle is completed. The receiving unit 131 detects the timing at which the lighting of the next cycle starts as the turning-off end timing for one cycle. If it is not determined in step S16 that the lighting start timing of the next cycle is detected (step S16: No), step S16 is repeated until the lighting start timing of the next cycle is detected.
ステップS18において、受信部131は、検出された1周期分の点灯開始タイミング、点灯終了タイミング(消灯開始タイミング)および消灯終了タイミングに基づいて、1周期分の点灯時間、消灯時間および点灯周期を検出する。シャッタ制御信号生成部133は、例えば、1周期分の点灯時間および点灯周期に基づいて、1フレーム期間中の光の遮蔽タイミング(遮蔽開始時間および遮蔽時間)を決定する。シャッタ制御信号生成部133は、決定された遮蔽タイミングに基づいて、シャッタ制御信号を生成する。
In step S18, the receiving unit 131 detects the lighting time, the lighting time, and the lighting cycle for one cycle based on the detected lighting start timing, lighting end timing (lighting start timing), and lighting end timing for one cycle. do. The shutter control signal generation unit 133 determines, for example, the light shielding timing (shielding start time and shielding time) during one frame period based on the lighting time and the lighting cycle for one cycle. The shutter control signal generation unit 133 generates a shutter control signal based on the determined shielding timing.
図4および図5はプロジェクタ120、シャッタ装置130、カメラ140および送信機150の動作の一例を示すタイミングチャートである。
4 and 5 are timing charts showing an example of the operation of the projector 120, the shutter device 130, the camera 140, and the transmitter 150.
露光期間(カメラシャッタ開)では、シャッタ装置130は遮蔽状態(ON)である。非露光期間(カメラシャッタ閉)では、シャッタ装置130は非遮蔽状態(OFF)である。プロジェクタ120は常に映像を投射している。シャッタ装置130は、プロジェクタ120の投射とカメラ140の撮影とが重なるタイミングで、プロジェクタ120からの投射光を遮蔽する。プロジェクタ120から投射される映像は、カメラ140の露光タイミングに合わせて、シャッタ装置130によって間欠的に遮蔽される。送信機150も同様に、露光期間は点灯し、非露光期間は消灯する。
During the exposure period (camera shutter open), the shutter device 130 is in a shielded state (ON). During the non-exposure period (camera shutter closed), the shutter device 130 is in the non-shielded state (OFF). The projector 120 always projects an image. The shutter device 130 shields the projected light from the projector 120 at the timing when the projection of the projector 120 and the shooting of the camera 140 overlap. The image projected from the projector 120 is intermittently shielded by the shutter device 130 according to the exposure timing of the camera 140. Similarly, the transmitter 150 is turned on during the exposure period and turned off during the non-exposure period.
図4は、カメラ140の露光期間(カメラシャッタ開)と非露光期間(カメラシャッタ閉)とが等しい場合のタイミングチャートである。図4の例では、カメラ140の露光時間とシャッタ装置130の非遮蔽時間が等しい。そのため、投射映像の明るさを大きく損なわずに、明るい画像が撮影される。図5は、非露光時間が露光時間よりも長い場合のタイミングチャートである。図5の例では、明るい映像が投射されるが、撮影画像の明るさは図4の例に比べて小さい。
FIG. 4 is a timing chart when the exposure period (camera shutter open) and the non-exposure period (camera shutter closed) of the camera 140 are equal. In the example of FIG. 4, the exposure time of the camera 140 and the non-shielding time of the shutter device 130 are equal. Therefore, a bright image is taken without significantly impairing the brightness of the projected image. FIG. 5 is a timing chart when the non-exposure time is longer than the exposure time. In the example of FIG. 5, a bright image is projected, but the brightness of the captured image is smaller than that of the example of FIG.
図6は、撮影画像の明るさと投射映像の明るさとの関係を示す図である。
FIG. 6 is a diagram showing the relationship between the brightness of the captured image and the brightness of the projected image.
撮影画像の明るさと投射映像の明るさはカメラ140の露光時間によって変化する。露光時間が長いほど明るい画像が撮影される。一方、露光時間が長いほど、シャッタ装置130による遮蔽時間は長くなる。そのため、プロジェクタ120の投射映像は暗くなる。よって、撮影画像の明るさと投射映像の明るさはトレードオフの関係となる。ユーザは、これらのトレードオフを加味して、撮影時のフェーズおよびスタジオSTの環境などに基づいて、露光時間を手動で設定することができる。また、受信部131で検出された露光タイミングの情報を映像出力部121に出力し、映像出力部121によって、投射映像の明るさを補正することもできる。
The brightness of the captured image and the brightness of the projected image change depending on the exposure time of the camera 140. The longer the exposure time, the brighter the image will be. On the other hand, the longer the exposure time, the longer the shielding time by the shutter device 130. Therefore, the projected image of the projector 120 becomes dark. Therefore, there is a trade-off between the brightness of the captured image and the brightness of the projected image. The user can manually set the exposure time based on the shooting phase, the studio ST environment, and the like in consideration of these trade-offs. Further, the exposure timing information detected by the receiving unit 131 can be output to the video output unit 121, and the video output unit 121 can correct the brightness of the projected image.
図7は、プロジェクタ120による演者ACへのコンテンツの提示処理の一例を示すフローチャートである。
FIG. 7 is a flowchart showing an example of the content presentation process to the performer AC by the projector 120.
ステップS21において、3Dモデル記憶部111は、情報処理装置110に入力された情報から、スタジオSTの3Dモデルを読み込み記憶する。ステップS22において、パラメータ記憶部112は、例えば、プロジェクタ120の内部パラメータおよび3Dモデル内のプロジェクタ120の位置姿勢情報を入力情報から読み込み記憶する。
In step S21, the 3D model storage unit 111 reads and stores the 3D model of the studio ST from the information input to the information processing device 110. In step S22, the parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 120 and the position / orientation information of the projector 120 in the 3D model from the input information.
ステップS23において、表示コンテンツ生成部113は、演者ACの演技をサポートする情報を含む投射用コンテンツを生成する。補正映像生成部114は、3Dモデルおよびプロジェクタ120の内部パラメータおよび3Dモデル中のプロジェクタ120の位置姿勢情報を用いて、投射用コンテンツを幾何補正し、補正映像を生成する。
In step S23, the display content generation unit 113 generates projection content including information that supports the performance of the performer AC. The corrected image generation unit 114 geometrically corrects the projection content using the internal parameters of the 3D model and the projector 120 and the position / orientation information of the projector 120 in the 3D model, and generates a corrected image.
ステップS24において、プロジェクタ120は、補正映像をスタジオSTに投射する。ステップS25において、補正映像は、カメラ140と同期したシャッタ装置130によって、カメラ140の露光タイミングに合わせて間欠的に遮蔽される。
In step S24, the projector 120 projects the corrected image onto the studio ST. In step S25, the corrected image is intermittently shielded by the shutter device 130 synchronized with the camera 140 in accordance with the exposure timing of the camera 140.
ステップS26において、プロジェクタ120は投射を終了するか否かを判定する。プロジェクタ120は、例えば、プロジェクタ120に設けられた図示略の投射終了ボタンが操作された場合に、投射が終了されたと判定する。ステップS26において投射が終了されたと判定された場合には(ステップS26:Yes)、プロジェクタ120は投射を終了する。ステップS26において投射が終了されたと判定されない場合には(ステップS26:No)、ステップS23に戻る。
In step S26, the projector 120 determines whether or not to end the projection. The projector 120 determines that the projection has been completed, for example, when the projection end button (not shown) provided on the projector 120 is operated. If it is determined in step S26 that the projection has been completed (step S26: Yes), the projector 120 ends the projection. If it is not determined in step S26 that the projection has been completed (step S26: No), the process returns to step S23.
なお、補正映像の生成方法は上述のものに限られない。図8は、補正映像PIの生成方法の他の例を示す図である。図9は、プロジェクタ120から投射される補正映像PIの一例を示す図である。
The method of generating the corrected video is not limited to the above. FIG. 8 is a diagram showing another example of the method of generating the corrected video PI. FIG. 9 is a diagram showing an example of a corrected image PI projected from the projector 120.
図8は、3Dモデル上に、2人の演者の演技をサポートする補正映像PIを入力した状態が示されている。図8では、補正映像PIとして、演者AC1用の立ち位置PI1および導線PI2と、演者AC2用の立ち位置PI3および導線PI4と、が示されている。この3Dモデルに対し、現在のプロジェクタの位置姿勢及び内部パラメータが同じ仮想カメラを配置し、入力したコンテンツを撮影する。撮影された映像をプロジェクタ120の投射映像として出力することで、図9に示すような、幾何補正された映像がスタジオSTの床面に表示される。
FIG. 8 shows a state in which a corrected video PI that supports the performances of two performers is input on the 3D model. In FIG. 8, as the corrected image PI, the standing position PI1 and the conducting wire PI2 for the performer AC1 and the standing position PI3 and the conducting wire PI4 for the performer AC2 are shown. A virtual camera having the same position and orientation and internal parameters of the current projector is placed on this 3D model, and the input content is photographed. By outputting the captured image as the projected image of the projector 120, the geometrically corrected image as shown in FIG. 9 is displayed on the floor surface of the studio ST.
[1-3.効果]
撮影システム1は、カメラ140とプロジェクタ120とシャッタ装置130とを有する。シャッタ装置130は、カメラ140と同期し、プロジェクタ120から投射されカメラ140へ入射する光を遮蔽する。本実施形態の撮影方法は、上述した撮影システムの情報処理がコンピュータにより実行される。本実施形態のプログラムは、上述した撮影システムの情報処理をコンピュータに実現させる。 [1-3. effect]
The photographing system 1 includes acamera 140, a projector 120, and a shutter device 130. The shutter device 130 synchronizes with the camera 140 and shields the light projected from the projector 120 and incident on the camera 140. In the photographing method of the present embodiment, the information processing of the photographing system described above is executed by the computer. The program of the present embodiment makes the computer realize the information processing of the above-mentioned photographing system.
撮影システム1は、カメラ140とプロジェクタ120とシャッタ装置130とを有する。シャッタ装置130は、カメラ140と同期し、プロジェクタ120から投射されカメラ140へ入射する光を遮蔽する。本実施形態の撮影方法は、上述した撮影システムの情報処理がコンピュータにより実行される。本実施形態のプログラムは、上述した撮影システムの情報処理をコンピュータに実現させる。 [1-3. effect]
The photographing system 1 includes a
この構成によれば、プロジェクタ120から投射された光は、カメラ140に入射する前にシャッタ装置130によって遮蔽される。そのため、カメラ140で撮影される画像にプロジェクタ120から投射された光(映像)は映り込まない。投射映像の映り込みは、カメラ140と同期したシャッタ装置130によって抑制される。そのため、プロジェクタ120には汎用機を用いることができる。よって、演者ACの負担を軽減しつつ低コストで撮影を行うことができる撮影システム1が提供される。
According to this configuration, the light projected from the projector 120 is shielded by the shutter device 130 before being incident on the camera 140. Therefore, the light (image) projected from the projector 120 is not reflected in the image captured by the camera 140. The reflection of the projected image is suppressed by the shutter device 130 synchronized with the camera 140. Therefore, a general-purpose machine can be used for the projector 120. Therefore, a shooting system 1 capable of shooting at low cost while reducing the burden on the performer AC is provided.
シャッタ装置130は、例えば、プロジェクタ120から投射される光を遮蔽する遮蔽時間をカメラ140の露光時間に合わせて動的に変更する。
For example, the shutter device 130 dynamically changes the shielding time for shielding the light projected from the projector 120 according to the exposure time of the camera 140.
この構成によれば、カメラ140の露光時間が変化してもカメラの映像に投射光が映り込むことが抑制される。
According to this configuration, the projected light is suppressed from being reflected in the image of the camera even if the exposure time of the camera 140 changes.
撮影システム1は、例えば、送信機150を有する。送信機150は、例えば、カメラ140の露光タイミングを示す信号を送信する。シャッタ装置130は、例えば、送信機150から送信された信号を受信し、この信号に基づいて遮蔽タイミングを制御する。
The photographing system 1 has, for example, a transmitter 150. The transmitter 150 transmits, for example, a signal indicating the exposure timing of the camera 140. The shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding timing based on this signal.
この構成によれば、カメラ140とシャッタ装置130との配置の自由度が高まる。
According to this configuration, the degree of freedom in arranging the camera 140 and the shutter device 130 is increased.
[2.第2実施形態]
[2-1.撮影システムの構成]
図10は、第2実施形態の撮影システム2の要部を示す図である。 [2. Second Embodiment]
[2-1. Shooting system configuration]
FIG. 10 is a diagram showing a main part of the photographingsystem 2 of the second embodiment.
[2-1.撮影システムの構成]
図10は、第2実施形態の撮影システム2の要部を示す図である。 [2. Second Embodiment]
[2-1. Shooting system configuration]
FIG. 10 is a diagram showing a main part of the photographing
本実施形態において第1実施形態と異なる点は、カメラ140の露光タイミングが変更されてから、シャッタ装置136の遮蔽タイミングが変更後のカメラ140の露光タイミングと同期するまでの期間中は、プロジェクタ125による光の投射が停止される点である。以下、第1実施形態との相違点を中心に説明を行う。
The difference between the first embodiment and the first embodiment is that the projector 125 is different from the first embodiment during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 136 is synchronized with the exposure timing of the camera 140 after the change. This is the point at which the projection of light by the camera is stopped. Hereinafter, the differences from the first embodiment will be mainly described.
受信部137は、例えば、送信機150から送信された信号に基づいて、プロジェクタ125の投射停止信号を生成する。受信部137は、例えば、露光時間の変動が閾値よりも大きい場合には、送信機150から信号を受信している期間だけ、プロジェクタ125に投射停止信号を出力する。受信部137は、例えば、露光時間の変動が閾値以内である場合には、プロジェクタ125に投射停止信号を出力しない。
The receiving unit 137 generates a projection stop signal of the projector 125 based on the signal transmitted from the transmitter 150, for example. For example, when the fluctuation of the exposure time is larger than the threshold value, the receiving unit 137 outputs the projection stop signal to the projector 125 only during the period of receiving the signal from the transmitter 150. The receiving unit 137 does not output the projection stop signal to the projector 125, for example, when the fluctuation of the exposure time is within the threshold value.
映像出力部126は、例えば、投射停止信号に基づいて、送信機150が信号の送信を開始してから所定の時間だけ、投射部122への投射映像信号の出力を停止する。送信機150から信号が送信される時間は、カメラ140とシャッタ装置136とを同期させるのに必要な時間に基づいて設定される。そのため、カメラ140の露光タイミングが変更されてから、シャッタ装置136の遮蔽タイミングが変更後のカメラ140の露光タイミングと同期するまでの期間中は、プロジェクタ125による光の投射は停止される。露光時間の変動が閾値以内である場合には、プロジェクタ125には投射停止信号は出力されない。そのため、遮蔽時間は変更されない。
The video output unit 126 stops the output of the projected video signal to the projection unit 122 for a predetermined time after the transmitter 150 starts transmitting the signal, for example, based on the projection stop signal. The time at which the signal is transmitted from the transmitter 150 is set based on the time required to synchronize the camera 140 and the shutter device 136. Therefore, the projection of light by the projector 125 is stopped during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 136 is synchronized with the exposure timing of the camera 140 after the change. When the fluctuation of the exposure time is within the threshold value, the projection stop signal is not output to the projector 125. Therefore, the shielding time is not changed.
シャッタ制御信号生成部138は、例えば、シャッタ装置136の遮蔽時間をカメラ140の露光時間よりも長く設定する。例えば、シャッタ装置136の遮蔽期間は、カメラ140の1フレーム期間において、遮蔽開始タイミングが露光開始タイミングよりも早く、遮蔽終了タイミングが露光終了タイミングよりも遅くなるように設定される。シャッタ制御部134は、遮蔽時間が露光時間よりも長く設定されたシャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。
The shutter control signal generation unit 138 sets, for example, the shielding time of the shutter device 136 to be longer than the exposure time of the camera 140. For example, the shielding period of the shutter device 136 is set so that the shielding start timing is earlier than the exposure start timing and the shielding end timing is later than the exposure end timing in one frame period of the camera 140. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the exposure time.
図11は、プロジェクタ125、シャッタ装置136、カメラ140および送信機150の動作の一例を示すタイミングチャートである。
FIG. 11 is a timing chart showing an example of the operation of the projector 125, the shutter device 136, the camera 140, and the transmitter 150.
シャッタ装置136の遮蔽期間には、遮蔽開始側および遮蔽終了側にそれぞれΔtのバッファ期間が設けられている。遮蔽開始タイミングは露光開始タイミングよりもΔtだけ早く、遮蔽終了タイミングは露光終了タイミングよりもΔtだけ遅い。受信部137は、例えば、バッファ期間を投射停止判定の基準となる閾値として用いる。受信部137は、例えば、露光時間がバッファ期間を超えて変動する場合には、投射停止信号を生成する。受信部137は、例えば、露光時間の変動がバッファ期間内に収まる場合には、投射停止信号を生成しない。
In the shielding period of the shutter device 136, a buffer period of Δt is provided on the shielding start side and the shielding end side, respectively. The shielding start timing is Δt earlier than the exposure start timing, and the shielding end timing is Δt later than the exposure end timing. The receiving unit 137 uses, for example, the buffer period as a threshold value as a reference for determining the projection stop. The receiving unit 137 generates a projection stop signal, for example, when the exposure time fluctuates beyond the buffer period. The receiving unit 137 does not generate a projection stop signal, for example, when the fluctuation of the exposure time falls within the buffer period.
[2-2.撮影方法]
図12は、本実施形態の撮影方法の一例を説明するフローチャートである。 [2-2. Shooting method]
FIG. 12 is a flowchart illustrating an example of the photographing method of the present embodiment.
図12は、本実施形態の撮影方法の一例を説明するフローチャートである。 [2-2. Shooting method]
FIG. 12 is a flowchart illustrating an example of the photographing method of the present embodiment.
ステップS31において、プロジェクタ125はスタジオSTに、演者ACの演技をサポートする映像を投射する。
In step S31, the projector 125 projects an image supporting the performance of the performer AC on the studio ST.
ステップS32において、受信部137は、送信機150から送信された信号に基づいて、カメラ140の露光時間が変更されたか否かを判定する。ステップS32において露光時間が変更されたと判定されない場合には(ステップS32:No)、露光時間が変更されるまでステップS32を繰り返す。
In step S32, the receiving unit 137 determines whether or not the exposure time of the camera 140 has been changed based on the signal transmitted from the transmitter 150. If it is not determined in step S32 that the exposure time has been changed (step S32: No), step S32 is repeated until the exposure time is changed.
ステップS32において露光時間が変更されたと判定された場合には(ステップS32:Yes)、ステップS33に進む。ステップS33において、受信部137は、露光時間の変動が閾値を超えるか否かを判定する。
If it is determined in step S32 that the exposure time has been changed (step S32: Yes), the process proceeds to step S33. In step S33, the receiving unit 137 determines whether or not the fluctuation of the exposure time exceeds the threshold value.
ステップS33において露光時間の変動が閾値を超えると判定された場合には(ステップS33:Yes)、ステップS34に進む。ステップS34において、受信部137は、プロジェクタ125に投射停止信号を出力する。プロジェクタ125は、投射停止信号に基づいて、映像の投射を停止する。そして、ステップS35において、シャッタ制御信号生成部133は、受信部137で検出された露光タイミングの情報に基づいてシャッタ制御信号を生成する。
If it is determined in step S33 that the fluctuation of the exposure time exceeds the threshold value (step S33: Yes), the process proceeds to step S34. In step S34, the receiving unit 137 outputs a projection stop signal to the projector 125. The projector 125 stops the projection of the image based on the projection stop signal. Then, in step S35, the shutter control signal generation unit 133 generates a shutter control signal based on the exposure timing information detected by the reception unit 137.
シャッタ制御信号生成部138は、シャッタ装置136の遮蔽時間をカメラ140の露光時間よりも長く設定する。シャッタ制御部134は、遮蔽時間が露光時間よりも長く設定されたシャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。
The shutter control signal generation unit 138 sets the shielding time of the shutter device 136 to be longer than the exposure time of the camera 140. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the exposure time.
ステップS33において露光時間の変動が閾値を超えると判定されない場合には(ステップS33:No)、ステップS35に進む。
If it is not determined in step S33 that the fluctuation of the exposure time exceeds the threshold value (step S33: No), the process proceeds to step S35.
遮蔽タイミングの変更後、ステップS36において、カメラ140は、撮影を終了するか否かを判定する。ステップS36において撮影が終了すると判定された場合には(ステップS36:Yes)、カメラ140は撮影を終了する。ステップS36において撮影が終了すると判定されない場合には(ステップS36:No)、ステップS31に戻る。
After changing the shielding timing, in step S36, the camera 140 determines whether or not to end the shooting. If it is determined in step S36 that the shooting is finished (step S36: Yes), the camera 140 ends the shooting. If it is not determined in step S36 that the shooting is finished (step S36: No), the process returns to step S31.
[2-3.効果]
本実施形態では、カメラ140の露光タイミングが変更されてから、シャッタ装置130の遮蔽タイミングが変更後のカメラ140の露光タイミングと同期するまでの期間中は、プロジェクタ120による光の投射は停止される。 [2-3. effect]
In the present embodiment, the projection of light by theprojector 120 is stopped during the period from when the exposure timing of the camera 140 is changed until the shielding timing of the shutter device 130 is synchronized with the exposure timing of the camera 140 after the change. ..
本実施形態では、カメラ140の露光タイミングが変更されてから、シャッタ装置130の遮蔽タイミングが変更後のカメラ140の露光タイミングと同期するまでの期間中は、プロジェクタ120による光の投射は停止される。 [2-3. effect]
In the present embodiment, the projection of light by the
この構成によれば、遮蔽タイミングの調整期間中に、投射光がカメラ140の撮影画像に映り込むことが抑制される。
According to this configuration, the projected light is suppressed from being reflected in the captured image of the camera 140 during the shielding timing adjustment period.
露光時間の変動が閾値以内である場合には、例えば、遮蔽時間は変更されない。
If the fluctuation of the exposure time is within the threshold value, for example, the shielding time is not changed.
この構成によれば、遮蔽時間の変更が生じない不感帯領域が設けられる。そのため、露光時間が頻繁に変更される場合でも、プロジェクタ120による情報の提示に支障が生じにくい。例えば、遮蔽タイミングの調整期間中に光の投射が停止される構成では、露光時間が頻繁に変更されると、プロジェクタ120による情報の提示に支障が生じる可能性がある。露光時間に不感帯領域を設けることで、このような問題は抑制される。
According to this configuration, a dead zone area where the shielding time does not change is provided. Therefore, even if the exposure time is changed frequently, the presentation of information by the projector 120 is unlikely to be hindered. For example, in a configuration in which the projection of light is stopped during the adjustment period of the shielding timing, if the exposure time is changed frequently, the presentation of information by the projector 120 may be hindered. By providing a dead zone region in the exposure time, such a problem can be suppressed.
カメラ140の1フレーム期間におけるシャッタ装置136の遮蔽時間は、例えば、カメラ140の露光時間よりも長い。
The shielding time of the shutter device 136 in one frame period of the camera 140 is longer than, for example, the exposure time of the camera 140.
この構成によれば、シャッタ装置136の遮蔽期間において露光期間の外側に設定されたバッファ期間内で露光時間が変動しても、投射映像が撮影画像に映り込まない。また、遮蔽期間にバッファ期間が設けられることで、各種機器の処理にラグがある場合でも、ラグに起因して撮影画像に投射映像が映り込むことが抑制される。例えば、シャッタ装置130が遮蔽を開始してから遮蔽が終了するまでの期間およびカメラシャッタが閉じ始められてから閉じ終わるまでの期間に、カメラ140の撮影画像にプロジェクタ120の投射光が映り込むことが抑制される。
According to this configuration, even if the exposure time fluctuates within the buffer period set outside the exposure period in the shielding period of the shutter device 136, the projected image is not reflected in the captured image. Further, by providing the buffer period in the shielding period, even if there is a lag in the processing of various devices, it is possible to suppress the projection image from being reflected in the captured image due to the lag. For example, the projected light of the projector 120 is reflected in the captured image of the camera 140 during the period from the start of the shutter device 130 to the end of the shielding and the period from the start of closing the camera shutter to the end of closing. Is suppressed.
[3.第3実施形態]
[3-1.撮影システムの構成]
図13は、第3実施形態の撮影システム3の概略図である。 [3. Third Embodiment]
[3-1. Shooting system configuration]
FIG. 13 is a schematic view of the photographing system 3 of the third embodiment.
[3-1.撮影システムの構成]
図13は、第3実施形態の撮影システム3の概略図である。 [3. Third Embodiment]
[3-1. Shooting system configuration]
FIG. 13 is a schematic view of the photographing system 3 of the third embodiment.
本実施形態において第1実施形態と異なる点は、シャッタ装置230が、プロジェクタ220と同期し、プロジェクタ220から投射されカメラ240へ入射する光を遮蔽する点である。以下、第1実施形態との相違点を中心に説明を行う。
The difference between the first embodiment and the first embodiment is that the shutter device 230 synchronizes with the projector 220 and shields the light projected from the projector 220 and incident on the camera 240. Hereinafter, the differences from the first embodiment will be mainly described.
情報処理装置210は、例えば、第1実施形態の構成に加えて、投射時間設定部215を有する。プロジェクタ220は、例えば、第1実施形態の構成に加えて、同期制御部223と、同期信号出力部224と、投射時間制御部225と、を有する。
The information processing device 210 has, for example, a projection time setting unit 215 in addition to the configuration of the first embodiment. The projector 220 has, for example, a synchronization control unit 223, a synchronization signal output unit 224, and a projection time control unit 225, in addition to the configuration of the first embodiment.
投射時間設定部215は、例えば、プロジェクタ220のリフレッシュレートおよび1リフレッシュ期間内のプロジェクタ220の投射時間を設定する。リフレッシュレートおよび投射時間は、例えば、ユーザが入力した設定値に設定される。投射時間設定部215は、例えば、リフレッシュレートおよび投射時間の少なくとも1つが変更された場合に、変更後のリフレッシュレートおよび投射時間を同期制御部223に出力する。
The projection time setting unit 215 sets, for example, the refresh rate of the projector 220 and the projection time of the projector 220 within one refresh period. The refresh rate and projection time are set, for example, to the set values entered by the user. For example, when at least one of the refresh rate and the projection time is changed, the projection time setting unit 215 outputs the changed refresh rate and the projection time to the synchronization control unit 223.
図14は、投射時間設定画面の一例を示す図である。
FIG. 14 is a diagram showing an example of a projection time setting screen.
情報処理装置210は、例えば、表示装置216に投射時間設定画面を表示する。表示装置216は、例えば、タッチパネル内蔵型の表示装置であり、投射時間設定画面への入力を行う入力装置を兼ねる。
The information processing device 210 displays the projection time setting screen on the display device 216, for example. The display device 216 is, for example, a display device with a built-in touch panel, and also serves as an input device for inputting to the projection time setting screen.
投射時間設定画面は、例えば、プロジェクタ220のリフレッシュレートを設定する領域と、プロジェクタ220の投射時間を設定する領域と、を有する。例えば、リフレッシュレートは、ユーザがラジオボタンをクリックすることによって設定される。選択肢として提示されるリフレッシュレートの大きさは、例えば、映画やドラマの撮影で用いられるフレームレート(24fps)よりも大きい。どの選択肢が選択された場合でも、プロジェクタ220のリフレッシュレートはカメラ240のフレームレートよりも大きい。
The projection time setting screen has, for example, an area for setting the refresh rate of the projector 220 and an area for setting the projection time of the projector 220. For example, the refresh rate is set by the user clicking a radio button. The magnitude of the refresh rate presented as an option is higher than, for example, the frame rate (24 fps) used in filming movies and dramas. Whichever option is selected, the refresh rate of the projector 220 is higher than the frame rate of the camera 240.
投射時間の設定可能範囲は、リフレッシュレートに連動して変化する。例えば、リフレッシュレートが60Hzである場合には、投射時間の設定可能範囲は0.0~16.7ミリ秒の範囲である。リフレッシュレートが120Hzである場合には、投射時間の設定可能範囲は0.0~8.3ミリ秒の範囲である。投射時間は、例えば、スライドバーSBを用いて設定される。例えば、リフレッシュレートが60Hzに設定され、投射時間がt秒に設定された場合、1リフレッシュ期間内の時刻0秒から時刻t秒までの期間が投射期間(映像が投射される期間)となり、残りの時刻t秒から時刻16,7秒までの期間が非投射期間(映像が投射される期間)となる。
The settable range of projection time changes according to the refresh rate. For example, when the refresh rate is 60 Hz, the settable range of the projection time is in the range of 0.0 to 16.7 milliseconds. When the refresh rate is 120 Hz, the settable range of the projection time is in the range of 0.0 to 8.3 milliseconds. The projection time is set using, for example, the slide bar SB. For example, when the refresh rate is set to 60 Hz and the projection time is set to t seconds, the period from time 0 seconds to time t seconds within one refresh period is the projection period (the period during which the image is projected), and the rest. The period from time t seconds to time 16.7 seconds is the non-projection period (the period during which the image is projected).
図13に戻って、同期制御部223は、投射時間に基づいて同期信号を生成する。同期制御部223は、同期信号を同期信号出力部224および投射時間制御部225に出力する。
Returning to FIG. 13, the synchronization control unit 223 generates a synchronization signal based on the projection time. The synchronization control unit 223 outputs a synchronization signal to the synchronization signal output unit 224 and the projection time control unit 225.
同期信号出力部224は、同期信号に基づいて、プロジェクタ220の投射タイミングを示す信号を送信機150から送信させる。投射時間制御部225は、投射タイミングに関する情報を映像出力部221に出力する。映像出力部221は、例えば、1リフレッシュ期間中に、設定された投射時間だけ映像が投射されるように、投射映像信号を生成する。これにより、投射部122からは、同期信号に合わせて間欠的に映像が投射される。
The synchronization signal output unit 224 causes the transmitter 150 to transmit a signal indicating the projection timing of the projector 220 based on the synchronization signal. The projection time control unit 225 outputs information regarding the projection timing to the video output unit 221. The video output unit 221 generates a projected video signal so that the video is projected for a set projection time during one refresh period, for example. As a result, the projection unit 122 intermittently projects an image in accordance with the synchronization signal.
送信機150は、例えば、同期信号線によってプロジェクタ120と接続される。同期信号出力部224は、例えば、同期信号に合わせて送信機150を所定時間だけ点滅させる。同期信号出力部224は、例えば、プロジェクタの投射時は送信機150が点灯し、プロジェクタ220の非投射時は送信機150が消灯するようなパターンで送信機150を点滅させる。プロジェクタ220の投射タイミングと送信機150の点灯タイミングはこれとは逆でもよい。
The transmitter 150 is connected to the projector 120 by, for example, a synchronization signal line. The synchronization signal output unit 224, for example, causes the transmitter 150 to blink for a predetermined time in accordance with the synchronization signal. The synchronous signal output unit 224 blinks the transmitter 150 in a pattern such that the transmitter 150 is turned on when the projector is projected and the transmitter 150 is turned off when the projector 220 is not projected. The projection timing of the projector 220 and the lighting timing of the transmitter 150 may be opposite to each other.
点滅時間(送信機150から信号が送信される時間)は、プロジェクタ220の投射タイミングとシャッタ装置130の遮蔽タイミングとを同期させるのに必要な時間に基づいて決定される。例えば、点滅時間は、1リフレッシュ期間以上で且つ10リフレッシュ期間以下の時間である。
The blinking time (time when a signal is transmitted from the transmitter 150) is determined based on the time required to synchronize the projection timing of the projector 220 with the shielding timing of the shutter device 130. For example, the blinking time is a time of 1 refresh period or more and 10 refresh periods or less.
カメラ240は、第1実施形態の構成と比較して、同期制御部142および同期信号出力部143を有しない。露光時間設定部141、露光制御部144および記録部146は、公知の構造を有する。カメラ240には、汎用機が用いられる。
The camera 240 does not have the synchronization control unit 142 and the synchronization signal output unit 143 as compared with the configuration of the first embodiment. The exposure time setting unit 141, the exposure control unit 144, and the recording unit 146 have known structures. A general-purpose machine is used for the camera 240.
シャッタ装置130の構成は、第1実施形態と同様である。シャッタ装置130は、例えば、送信機150から送信された信号を受信し、この信号に基づいて遮蔽時間を制御する。
The configuration of the shutter device 130 is the same as that of the first embodiment. The shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal.
シャッタ部材135は、例えば、カメラ240に入射する光の光軸上に配置される。シャッタ制御信号生成部133は、受信部131で受信した信号に基づいて、シャッタ制御信号を生成する。シャッタ制御信号は、例えば、送信機150の点灯時間および点灯周期に対応する遮蔽時間および遮蔽周期の情報を有する信号である。シャッタ制御部134は、シャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。これにより、シャッタ装置130は、プロジェクタ220の投射時間に合わせて、カメラ240へ入射する光を遮蔽する遮蔽時間を動的に変更する。
The shutter member 135 is arranged, for example, on the optical axis of the light incident on the camera 240. The shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131. The shutter control signal is, for example, a signal having information on the shielding time and the shielding cycle corresponding to the lighting time and the lighting cycle of the transmitter 150. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal. As a result, the shutter device 130 dynamically changes the shielding time for shielding the light incident on the camera 240 according to the projection time of the projector 220.
[3-2.撮影方法]
図15は、本実施形態の撮影方法の一例を示すフローチャートである。 [3-2. Shooting method]
FIG. 15 is a flowchart showing an example of the photographing method of the present embodiment.
図15は、本実施形態の撮影方法の一例を示すフローチャートである。 [3-2. Shooting method]
FIG. 15 is a flowchart showing an example of the photographing method of the present embodiment.
ステップS41において、3Dモデル記憶部111は、情報処理装置110に入力された情報から、スタジオSTの3Dモデルを読み込み記憶する。ステップS42において、パラメータ記憶部112は、例えば、プロジェクタ220の内部パラメータおよび3Dモデル内のプロジェクタ220の位置姿勢情報を入力情報から読み込み記憶する。
In step S41, the 3D model storage unit 111 reads and stores the 3D model of the studio ST from the information input to the information processing device 110. In step S42, the parameter storage unit 112 reads and stores, for example, the internal parameters of the projector 220 and the position / orientation information of the projector 220 in the 3D model from the input information.
ステップS43において、受信部131は、送信機150から送信された信号を受信する。シャッタ制御信号生成部133は、受信部131で受信した信号に基づいて、シャッタ制御信号を生成する。シャッタ制御部134は、シャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングをプロジェクタ220の投射タイミングと同期させる。
In step S43, the receiving unit 131 receives the signal transmitted from the transmitter 150. The shutter control signal generation unit 133 generates a shutter control signal based on the signal received by the reception unit 131. The shutter control unit 134 synchronizes the shielding timing of the shutter member 135 with the projection timing of the projector 220 based on the shutter control signal.
ステップS44において、表示コンテンツ生成部113は、演者ACの演技をサポートする情報を含む投射用コンテンツを生成する。補正映像生成部114は、3Dモデルおよびプロジェクタ220の内部パラメータおよび3Dモデル中のプロジェクタ220の位置姿勢情報を用いて、投射用コンテンツを幾何補正し、補正映像を生成する。
In step S44, the display content generation unit 113 generates projection content including information that supports the performance of the performer AC. The corrected image generation unit 114 geometrically corrects the projection content using the internal parameters of the 3D model and the projector 220 and the position / orientation information of the projector 220 in the 3D model, and generates a corrected image.
ステップS45において、プロジェクタ120は、補正映像をスタジオSTに投射する。カメラ240は、スタジオSTで演技する演者を撮影する。カメラ240に入射する光は、プロジェクタ220と同期したシャッタ装置130によって、プロジェクタ220の投射タイミングに合わせて間欠的に遮蔽される。これにより、カメラ240の撮影画像に投射映像が映り込むことが抑制される。
In step S45, the projector 120 projects the corrected image onto the studio ST. The camera 240 photographs the performer performing in the studio ST. The light incident on the camera 240 is intermittently shielded by the shutter device 130 synchronized with the projector 220 in accordance with the projection timing of the projector 220. As a result, it is possible to prevent the projected image from being reflected in the captured image of the camera 240.
ステップS46において、投射時間設定部215は、投射時間が変更されたか否かを判定する。投射時間設定部215は、例えば、ユーザが手動で投射時間を設定した場合に、投射時間が変更されたと判定する。
In step S46, the projection time setting unit 215 determines whether or not the projection time has been changed. The projection time setting unit 215 determines that the projection time has been changed, for example, when the user manually sets the projection time.
ステップS46において投射時間が変更されたと判定された場合には(ステップS46:Yes)、ステップS43に戻る。
If it is determined in step S46 that the projection time has been changed (step S46: Yes), the process returns to step S43.
ステップS46において投射時間が変更されていないと判定された場合には(ステップS46:No)、ステップS47に進む。ステップS47において、プロジェクタ220は投射を終了するか否かを判定する。ステップS47において投射が終了されたと判定された場合には(ステップS47:Yes)、プロジェクタ220は投射を終了する。ステップS47において投射が終了されたと判定されない場合には(ステップS47:No)、ステップS44に戻る。
If it is determined in step S46 that the projection time has not been changed (step S46: No), the process proceeds to step S47. In step S47, the projector 220 determines whether or not to end the projection. If it is determined in step S47 that the projection has been completed (step S47: Yes), the projector 220 ends the projection. If it is not determined in step S47 that the projection has been completed (step S47: No), the process returns to step S44.
図16および図17はプロジェクタ220、送信機150、シャッタ装置130およびカメラ240の動作の一例を示すタイミングチャートである。
16 and 17 are timing charts showing an example of the operation of the projector 220, the transmitter 150, the shutter device 130, and the camera 240.
投射期間では、シャッタ装置130は遮蔽状態(ON)である。非投射期間では、シャッタ装置130は非遮蔽状態(OFF)である。プロジェクタ220は、カメラ240のフレームレートよりも大きいリフレッシュレート、より好ましくはフレームレートの2倍以上のリフレッシュレートで映像を投射する。シャッタ装置130は、プロジェクタ220の投射とカメラ240の撮影とが重なるタイミングで、カメラ240に入射する光を遮蔽する。カメラ240に入射する光は、プロジェクタ220の投射タイミングに合わせて、シャッタ装置130によって間欠的に遮蔽される。送信機150も同様に、投射期間は点灯し、非投射期間は消灯する。
During the projection period, the shutter device 130 is in the shielded state (ON). During the non-projection period, the shutter device 130 is in the non-shielded state (OFF). The projector 220 projects an image at a refresh rate higher than the frame rate of the camera 240, more preferably at a refresh rate that is at least twice the frame rate. The shutter device 130 shields the light incident on the camera 240 at the timing when the projection of the projector 220 and the shooting of the camera 240 overlap. The light incident on the camera 240 is intermittently shielded by the shutter device 130 in accordance with the projection timing of the projector 220. Similarly, the transmitter 150 is turned on during the projection period and turned off during the non-projection period.
図16は、投射時間と非投射時間とが等しい場合のタイミングチャートである。図16の例では、プロジェクタ220の投射時間とシャッタ装置130の非遮蔽時間とが等しい。そのため、投射映像の明るさを大きく損なわずに、明るい画像が撮影される。図17は、非投射時間が投射時間よりも長い場合のタイミングチャートである。図17の例では、投射される映像は暗くなるが、カメラシャッタによる遮蔽時間は短くなるため、撮影画像の明るさは図16の例に比べて明るい。
FIG. 16 is a timing chart when the projection time and the non-projection time are equal. In the example of FIG. 16, the projection time of the projector 220 and the non-shielding time of the shutter device 130 are equal. Therefore, a bright image is taken without significantly impairing the brightness of the projected image. FIG. 17 is a timing chart when the non-projection time is longer than the projection time. In the example of FIG. 17, the projected image is dark, but the shielding time by the camera shutter is short, so that the brightness of the captured image is brighter than that of the example of FIG.
図18は、撮影画像の明るさと投射映像の明るさとの関係を示す図である。
FIG. 18 is a diagram showing the relationship between the brightness of the captured image and the brightness of the projected image.
撮影画像の明るさと投射映像の明るさはプロジェクタ220の投射時間によって変化する。投射時間が長いほど明るい映像が投射される。一方、投射時間が長いほど、シャッタ装置130による遮蔽時間は長くなる。そのため、撮影画像は暗くなる。よって、撮影画像の明るさと投射映像の明るさはトレードオフの関係となる。ユーザは、これらのトレードオフを加味して、撮影時のフェーズおよびスタジオSTの環境などに基づいて、投射時間を手動で設定することができる。また、投射時間設定部215で設定された投射時間の情報を映像出力部221に出力し、映像出力部221によって、投射映像の明るさを補正することもできる。
The brightness of the captured image and the brightness of the projected image change depending on the projection time of the projector 220. The longer the projection time, the brighter the image will be projected. On the other hand, the longer the projection time, the longer the shielding time by the shutter device 130. Therefore, the captured image becomes dark. Therefore, there is a trade-off between the brightness of the captured image and the brightness of the projected image. The user can manually set the projection time based on the shooting phase, the studio ST environment, and the like, taking these trade-offs into consideration. Further, the projection time information set by the projection time setting unit 215 can be output to the video output unit 221, and the brightness of the projected image can be corrected by the video output unit 221.
[3-3.効果]
本実施形態では、シャッタ装置130は、プロジェクタ220の投射時間に合わせて、カメラ240へ入射する光を遮蔽する遮蔽時間を動的に変更する。 [3-3. effect]
In the present embodiment, theshutter device 130 dynamically changes the shielding time for shielding the light incident on the camera 240 according to the projection time of the projector 220.
本実施形態では、シャッタ装置130は、プロジェクタ220の投射時間に合わせて、カメラ240へ入射する光を遮蔽する遮蔽時間を動的に変更する。 [3-3. effect]
In the present embodiment, the
この構成によれば、プロジェクタ220の投射時間が変化してもカメラ240の映像に投射光が映り込むことが抑制される。
According to this configuration, the projected light is suppressed from being reflected in the image of the camera 240 even if the projection time of the projector 220 changes.
プロジェクタ220のリフレッシュレートは、例えば、カメラ240のフレームレートよりも大きい。
The refresh rate of the projector 220 is higher than the frame rate of the camera 240, for example.
この構成によれば、1フレーム期間中、常にカメラ240への入射光がシャッタ装置130によって遮蔽されるという不具合が生じにくい。
According to this configuration, the problem that the incident light to the camera 240 is always blocked by the shutter device 130 during one frame period is unlikely to occur.
撮影システム3は、例えば、送信機150を有する。送信機150は、例えば、プロジェクタ220の投射タイミングを示す信号を送信する。シャッタ装置130は、例えば、送信機150から送信された信号を受信し、この信号に基づいて遮蔽時間を制御する。
The photographing system 3 has, for example, a transmitter 150. The transmitter 150 transmits, for example, a signal indicating the projection timing of the projector 220. The shutter device 130 receives, for example, a signal transmitted from the transmitter 150, and controls the shielding time based on this signal.
この構成によれば、プロジェクタ220とシャッタ装置130との配置の自由度が高まる。
According to this configuration, the degree of freedom in arranging the projector 220 and the shutter device 130 is increased.
[4.第4実施形態]
[4-1.撮影システムの構成]
図19は、第4実施形態の撮影システム4の要部を示す図である。 [4. Fourth Embodiment]
[4-1. Shooting system configuration]
FIG. 19 is a diagram showing a main part of the photographingsystem 4 of the fourth embodiment.
[4-1.撮影システムの構成]
図19は、第4実施形態の撮影システム4の要部を示す図である。 [4. Fourth Embodiment]
[4-1. Shooting system configuration]
FIG. 19 is a diagram showing a main part of the photographing
本実施形態において第3実施形態と異なる点は、プロジェクタ226の投射タイミングが変更されてから、シャッタ装置230の遮蔽タイミングが変更後のプロジェクタ226の投射タイミングと同期するまでの期間中は、プロジェクタ226による光の投射は停止される点である。以下、第3実施形態との相違点を中心に説明を行う。
The difference between the third embodiment and the third embodiment is that the projector 226 is different from the third embodiment during the period from the change of the projection timing of the projector 226 to the synchronization of the shielding timing of the shutter device 230 with the projection timing of the changed projector 226. The point where the projection of light by is stopped. Hereinafter, the differences from the third embodiment will be mainly described.
同期制御部227は、例えば、投射時間設定部215から出力された投射時間の情報に基づいて、プロジェクタ226の投射停止信号を生成する。同期制御部227は、例えば、投射時間の変動が閾値よりも大きい場合には、送信機150が信号の送信を開始してから所定の時間だけ、映像出力部228に投射停止信号を出力する。同期制御部227は、例えば、投射時間の変動が閾値以内である場合には、映像出力部228に投射停止信号を出力しない。
The synchronization control unit 227 generates, for example, a projection stop signal of the projector 226 based on the projection time information output from the projection time setting unit 215. For example, when the fluctuation of the projection time is larger than the threshold value, the synchronization control unit 227 outputs the projection stop signal to the video output unit 228 for a predetermined time after the transmitter 150 starts transmitting the signal. The synchronization control unit 227 does not output a projection stop signal to the video output unit 228, for example, when the fluctuation of the projection time is within the threshold value.
映像出力部228は、例えば、投射停止信号に基づいて、送信機150が信号の送信を開始してから所定の時間だけ、投射部122への投射映像信号の出力を停止する。送信機150から信号が送信される時間は、プロジェクタ226とシャッタ装置230とを同期させるのに必要な時間に基づいて設定される。そのため、プロジェクタ226の投射タイミングが変更されてから、シャッタ装置230の遮蔽タイミングが変更後のプロジェクタ226の投射タイミングと同期するまでの期間中は、プロジェクタ226による光の投射は停止される。投射時間の変動が閾値以内である場合には、映像出力部228には投射停止信号は出力されない。そのため、遮蔽時間は変更されない。
The video output unit 228 stops the output of the projected video signal to the projection unit 122 for a predetermined time after the transmitter 150 starts transmitting the signal, for example, based on the projection stop signal. The time at which the signal is transmitted from the transmitter 150 is set based on the time required to synchronize the projector 226 and the shutter device 230. Therefore, the projection of light by the projector 226 is stopped during the period from when the projection timing of the projector 226 is changed until the shielding timing of the shutter device 230 is synchronized with the projection timing of the changed projector 226. When the fluctuation of the projection time is within the threshold value, the projection stop signal is not output to the video output unit 228. Therefore, the shielding time is not changed.
シャッタ制御信号生成部233は、例えば、プロジェクタ226の1リフレッシュ期間におけるシャッタ装置230の遮蔽時間をプロジェクタ226の投射時間よりも長く設定する。例えば、シャッタ装置230の遮蔽期間は、プロジェクタ226の1リフレッシュ期間において、遮蔽開始タイミングが投射開始タイミングよりも早く、遮蔽終了タイミングが投射終了タイミングよりも遅くなるように設定される。シャッタ制御部134は、遮蔽時間が投射時間よりも長く設定されたシャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。
The shutter control signal generation unit 233 sets, for example, the shielding time of the shutter device 230 in one refresh period of the projector 226 to be longer than the projection time of the projector 226. For example, the shielding period of the shutter device 230 is set so that the shielding start timing is earlier than the projection start timing and the shielding end timing is later than the projection end timing in one refresh period of the projector 226. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the projection time.
図20は、プロジェクタ266、送信機150、シャッタ装置230およびカメラ240の動作の一例を示すタイミングチャートである。
FIG. 20 is a timing chart showing an example of the operation of the projector 266, the transmitter 150, the shutter device 230, and the camera 240.
シャッタ装置230の遮蔽期間には、遮蔽開始側および遮蔽終了側にそれぞれΔsのバッファ期間が設けられている。遮蔽開始タイミングは投射開始タイミングよりもΔsだけ早く、遮蔽終了タイミングは投射終了タイミングよりもΔsだけ遅い。同期制御部227は、例えば、バッファ期間を投射停止判定の基準となる閾値として用いる。同期制御部227は、例えば、投射時間がバッファ期間を超えて変動する場合には、投射停止信号を生成する。同期制御部227は、例えば、投射時間の変動がバッファ期間内に収まる場合には、投射停止信号を生成しない。
In the shielding period of the shutter device 230, a buffer period of Δs is provided on each of the shielding start side and the shielding end side. The shielding start timing is Δs earlier than the projection start timing, and the shielding end timing is Δs later than the projection end timing. The synchronization control unit 227 uses, for example, the buffer period as a threshold value as a reference for determining the projection stop. The synchronization control unit 227 generates a projection stop signal, for example, when the projection time fluctuates beyond the buffer period. The synchronization control unit 227 does not generate a projection stop signal, for example, when the fluctuation of the projection time falls within the buffer period.
[4-2.撮影方法]
図21は、本実施形態の撮影方法の一例を説明するフローチャートである。 [4-2. Shooting method]
FIG. 21 is a flowchart illustrating an example of the photographing method of the present embodiment.
図21は、本実施形態の撮影方法の一例を説明するフローチャートである。 [4-2. Shooting method]
FIG. 21 is a flowchart illustrating an example of the photographing method of the present embodiment.
ステップS51において、プロジェクタ226はスタジオSTに、演者ACの演技をサポートする映像を投射する。
In step S51, the projector 226 projects an image supporting the performance of the performer AC on the studio ST.
ステップS52において、同期制御部227は、投射時間設定部215から出力された投射時間の情報に基づいて、プロジェクタ226の投射時間が変更されたか否かを判定する。ステップS52において投射時間が変更されたと判定されない場合には(ステップS52:No)、投射時間が変更されるまでステップS52を繰り返す。
In step S52, the synchronization control unit 227 determines whether or not the projection time of the projector 226 has been changed based on the projection time information output from the projection time setting unit 215. If it is not determined in step S52 that the projection time has been changed (step S52: No), step S52 is repeated until the projection time is changed.
ステップS52において投射時間が変更されたと判定された場合には(ステップS52:Yes)、ステップS53に進む。ステップS53において、同期制御部227は、投射時間の変動が閾値を超えるか否かを判定する。
If it is determined in step S52 that the projection time has been changed (step S52: Yes), the process proceeds to step S53. In step S53, the synchronization control unit 227 determines whether or not the fluctuation of the projection time exceeds the threshold value.
ステップS53において投射時間の変動が閾値を超えると判定された場合には(ステップS53:Yes)、ステップS54に進む。ステップS54において、同期制御部227は、映像出力部228に投射停止信号を出力する。プロジェクタ226は、投射停止信号に基づいて、映像の投射を停止する。そして、ステップS55において、シャッタ制御信号生成部233は、受信部131で検出された投射タイミングの情報に基づいてシャッタ制御信号を生成する。
If it is determined in step S53 that the fluctuation of the projection time exceeds the threshold value (step S53: Yes), the process proceeds to step S54. In step S54, the synchronization control unit 227 outputs a projection stop signal to the video output unit 228. The projector 226 stops the projection of the image based on the projection stop signal. Then, in step S55, the shutter control signal generation unit 233 generates a shutter control signal based on the projection timing information detected by the reception unit 131.
シャッタ制御信号生成部233は、シャッタ装置230の遮蔽時間を、プロジェクタ226の投射時間よりも長く設定する。シャッタ制御部134は、遮蔽時間が投射時間よりも長く設定されたシャッタ制御信号に基づいて、シャッタ部材135の遮蔽タイミングを制御する。
The shutter control signal generation unit 233 sets the shielding time of the shutter device 230 longer than the projection time of the projector 226. The shutter control unit 134 controls the shielding timing of the shutter member 135 based on the shutter control signal in which the shielding time is set longer than the projection time.
ステップS53において投射時間の変動が閾値を超えると判定されない場合には(ステップS53:No)、ステップS55に進む。
If it is not determined in step S53 that the fluctuation of the projection time exceeds the threshold value (step S53: No), the process proceeds to step S55.
遮蔽タイミングの変更後、ステップS56において、カメラ240は、撮影を終了するか否かを判定する。ステップS56において撮影が終了すると判定された場合には(ステップS56:Yes)、カメラ240は撮影を終了する。ステップS56において撮影が終了すると判定されない場合には(ステップS56:No)、ステップS51に戻る。
After changing the shielding timing, in step S56, the camera 240 determines whether or not to end the shooting. If it is determined in step S56 that the shooting is finished (step S56: Yes), the camera 240 finishes the shooting. If it is not determined in step S56 that the shooting is finished (step S56: No), the process returns to step S51.
[4-3.効果]
本実施形態では、プロジェクタ226の投射タイミングが変更されてから、シャッタ装置230の遮蔽タイミングが変更後のプロジェクタ226の投射タイミングと同期するまでの期間中は、例えば、プロジェクタ226による光の投射は停止される。 [4-3. effect]
In the present embodiment, for example, the projection of light by theprojector 226 is stopped during the period from the change of the projection timing of the projector 226 to the synchronization of the shielding timing of the shutter device 230 with the projection timing of the changed projector 226. Will be done.
本実施形態では、プロジェクタ226の投射タイミングが変更されてから、シャッタ装置230の遮蔽タイミングが変更後のプロジェクタ226の投射タイミングと同期するまでの期間中は、例えば、プロジェクタ226による光の投射は停止される。 [4-3. effect]
In the present embodiment, for example, the projection of light by the
この構成によれば、遮蔽タイミングの調整期間中に、投射光がカメラ240の映像に映り込むことが抑制される。
According to this configuration, the projected light is suppressed from being reflected in the image of the camera 240 during the adjustment period of the shielding timing.
投射時間の変動が閾値以内である場合には、例えば、遮蔽時間は変更されない。
If the fluctuation of the projection time is within the threshold value, for example, the shielding time is not changed.
この構成によれば、遮蔽時間の変更が生じない不感帯領域が設けられる。そのため、投射時間が頻繁に変更される場合でも、プロジェクタ226による情報の提示に支障が生じにくい。
According to this configuration, a dead zone area where the shielding time does not change is provided. Therefore, even if the projection time is changed frequently, the presentation of information by the projector 226 is unlikely to be hindered.
プロジェクタ226の1リフレッシュ期間におけるシャッタ装置230の遮蔽時間は、例えば、プロジェクタ226の投射時間よりも長い。
The shielding time of the shutter device 230 in one refresh period of the projector 226 is longer than, for example, the projection time of the projector 226.
この構成によれば、シャッタ装置230の遮蔽期間において投射期間の外側に設定されたバッファ期間内で投射時間が変動しても、投射映像が撮影画像に映り込まない。また、遮蔽期間にバッファ期間が設けられることで、各種機器の処理にラグがある場合でも、ラグに起因して撮影画像に投射映像が映り込むことが抑制される。例えば、シャッタ装置230が遮蔽を開始してから遮蔽が終了するまでの期間およびプロジェクタ226が1画面の映像を表示し始めてから表示し終わるまでの期間に、カメラ240の映像に投射光が映り込むことが抑制される。
According to this configuration, even if the projection time fluctuates within the buffer period set outside the projection period during the shielding period of the shutter device 230, the projected image is not reflected in the captured image. Further, by providing the buffer period in the shielding period, even if there is a lag in the processing of various devices, it is possible to suppress the projection image from being reflected in the captured image due to the lag. For example, the projected light is reflected in the image of the camera 240 during the period from the start of the shutter device 230 to the end of the shielding and the period from the start of the projector 226 displaying the image on one screen to the end of the display. Is suppressed.
[5.変形例]
上記実施形態では、スタジオSTにプロジェクタが1台だけ設置された例が示されているが、プロジェクタの数は1台に限られない。スタジオSTの全領域に投射できるように複数台のプロジェクタがスタジオSTに設置されてもよい。第1実施形態および第2実施形態において複数のプロジェクタがスタジオSTに設置される場合には、プロジェクタごとにシャッタ装置が設けられる。第3実施形態および第4実施形態において複数のプロジェクタがスタジオSTに設置される場合には、プロジェクタどうし、および、送信機どうしが同期される。少数のプロジェクタでスタジオSTの全領域を投射する場合には、駆動機構によって任意の方向に映像を投射可能なプロジェクタを用いてもよい。 [5. Modification example]
In the above embodiment, an example in which only one projector is installed in the studio ST is shown, but the number of projectors is not limited to one. A plurality of projectors may be installed in the studio ST so that the entire area of the studio ST can be projected. When a plurality of projectors are installed in the studio ST in the first embodiment and the second embodiment, a shutter device is provided for each projector. When a plurality of projectors are installed in the studio ST in the third embodiment and the fourth embodiment, the projectors and the transmitters are synchronized with each other. When projecting the entire area of the studio ST with a small number of projectors, a projector capable of projecting an image in any direction by a drive mechanism may be used.
上記実施形態では、スタジオSTにプロジェクタが1台だけ設置された例が示されているが、プロジェクタの数は1台に限られない。スタジオSTの全領域に投射できるように複数台のプロジェクタがスタジオSTに設置されてもよい。第1実施形態および第2実施形態において複数のプロジェクタがスタジオSTに設置される場合には、プロジェクタごとにシャッタ装置が設けられる。第3実施形態および第4実施形態において複数のプロジェクタがスタジオSTに設置される場合には、プロジェクタどうし、および、送信機どうしが同期される。少数のプロジェクタでスタジオSTの全領域を投射する場合には、駆動機構によって任意の方向に映像を投射可能なプロジェクタを用いてもよい。 [5. Modification example]
In the above embodiment, an example in which only one projector is installed in the studio ST is shown, but the number of projectors is not limited to one. A plurality of projectors may be installed in the studio ST so that the entire area of the studio ST can be projected. When a plurality of projectors are installed in the studio ST in the first embodiment and the second embodiment, a shutter device is provided for each projector. When a plurality of projectors are installed in the studio ST in the third embodiment and the fourth embodiment, the projectors and the transmitters are synchronized with each other. When projecting the entire area of the studio ST with a small number of projectors, a projector capable of projecting an image in any direction by a drive mechanism may be used.
第1実施形態では、送信機150の点灯および消灯のタイミングとシャッタ装置130の遮蔽および透過のタイミングとは一致している。しかし、第2実施形態のように、シャッタ装置130の遮蔽期間にバッファ期間を設けてもよい。この場合、カメラ140の1フレーム期間におけるシャッタ装置130の遮蔽時間はカメラ140の露光時間よりも長い。この構成によれば、各種機器の処理にラグがある場合でも、ラグに起因して撮影画像に投射映像が映り込むことが抑制される。
In the first embodiment, the timing of turning on and off the transmitter 150 and the timing of shielding and transmitting through the shutter device 130 coincide with each other. However, as in the second embodiment, a buffer period may be provided in the shielding period of the shutter device 130. In this case, the shielding time of the shutter device 130 in one frame period of the camera 140 is longer than the exposure time of the camera 140. According to this configuration, even if there is a lag in the processing of various devices, it is possible to prevent the projected image from being reflected in the captured image due to the lag.
機器のラグとしては、以下のようなものが考えらえる。
(a)撮影カメラ
カメラシャッタが閉じ始めてから、完全に光が遮蔽されるまで、あるいはその逆の動作のラグが存在する。
(b)プロジェクタ
レーザプロジェクタを使用する場合、ラスタスキャン方式による映像投射、あるいは映像投射から非投射までのラグが存在する。
(c)シャッタ装置
液晶シャッタを使用する場合、遮蔽を開始してから、画面全体が遮蔽されるまで、あるいはその逆の動作のラグが存在する。 The following can be considered as equipment lags.
(A) Shooting camera There is a lag of operation from when the camera shutter starts to close until the light is completely blocked, or vice versa.
(B) Projector When a laser projector is used, there is a lag from image projection by the raster scan method or image projection to non-projection.
(C) Shutter device When using a liquid crystal shutter, there is a lag in operation from the start of shielding until the entire screen is shielded, or vice versa.
(a)撮影カメラ
カメラシャッタが閉じ始めてから、完全に光が遮蔽されるまで、あるいはその逆の動作のラグが存在する。
(b)プロジェクタ
レーザプロジェクタを使用する場合、ラスタスキャン方式による映像投射、あるいは映像投射から非投射までのラグが存在する。
(c)シャッタ装置
液晶シャッタを使用する場合、遮蔽を開始してから、画面全体が遮蔽されるまで、あるいはその逆の動作のラグが存在する。 The following can be considered as equipment lags.
(A) Shooting camera There is a lag of operation from when the camera shutter starts to close until the light is completely blocked, or vice versa.
(B) Projector When a laser projector is used, there is a lag from image projection by the raster scan method or image projection to non-projection.
(C) Shutter device When using a liquid crystal shutter, there is a lag in operation from the start of shielding until the entire screen is shielded, or vice versa.
例えば、シャッタ装置130のラグの大きさを決定する場合には、次のような測定が行われる。第1実施形態の構成の場合、まず、シャッタ装置130の光射出側にフォトダイオードが設置される。そして、シャッタ装置ごしにプロジェクタ120の投射光の強度が測定される。
For example, when determining the size of the lag of the shutter device 130, the following measurement is performed. In the case of the configuration of the first embodiment, first, a photodiode is installed on the light emitting side of the shutter device 130. Then, the intensity of the projected light of the projector 120 is measured through the shutter device.
図22は、シャッタ装置ごしに測定された光強度の測定結果の一例を示す図である。シャッタ装置がオン状態からオフ状態へ変化する場合、および、オフ状態からオン状態に変化する場合には、シャッタ装置130の切り替えタイミングと光強度が切り替わるタイミングとの間に僅かなずれが生じる。このずれを計測することで、必要なバッファ期間の大きさが検出される。
FIG. 22 is a diagram showing an example of the measurement result of the light intensity measured through the shutter device. When the shutter device changes from the on state to the off state and when the shutter device changes from the off state to the on state, a slight deviation occurs between the switching timing of the shutter device 130 and the switching timing of the light intensity. By measuring this deviation, the size of the required buffer period can be detected.
上記の実施形態では、シャッタ装置として液晶シャッタが用いられたが、シャッタ装置は液晶シャッタに限られない。光透過窓が設けられた回転ホイールを用いて光の透過状態と遮蔽状態とが切り替えられてもよい。回転ホイールの回転速度を変化させることで、遮蔽の周期が変更される。光透過窓の大きさを連続的に変化させることが可能な機構を設けることで、遮蔽時間が変更される。
In the above embodiment, the liquid crystal shutter is used as the shutter device, but the shutter device is not limited to the liquid crystal shutter. A rotating wheel provided with a light transmitting window may be used to switch between a light transmitting state and a light blocking state. By changing the rotation speed of the rotating wheel, the shielding cycle is changed. The shielding time is changed by providing a mechanism capable of continuously changing the size of the light transmitting window.
上記の実施形態では、送信機150としてIRエミッタが用いられたが、送信機150はIRエミッタに限定されない。シャッタ装置がカメラまたはプロジェクタと有線または無線の通信を行うことで同期が行われてもよい。
In the above embodiment, the IR emitter is used as the transmitter 150, but the transmitter 150 is not limited to the IR emitter. Synchronization may be performed by the shutter device communicating with the camera or projector by wire or wirelessly.
なお、本明細書に記載された効果はあくまで例示であって限定されるものでは無く、また他の効果があってもよい。
Note that the effects described in this specification are merely examples and are not limited, and other effects may be obtained.
なお、本技術は以下のような構成も取ることができる。
Note that this technology can also take the following configurations.
(1)
カメラと、
プロジェクタと、
前記カメラまたは前記プロジェクタと同期し、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽するシャッタ装置と、
を有する撮影システム。
(2)
前記シャッタ装置は、前記プロジェクタから投射される光を遮蔽する遮蔽時間を前記カメラの露光時間に合わせて動的に変更する
前記(1)に記載の撮影システム。
(3)
前記カメラの露光タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
前記(2)に記載の撮影システム。
(4)
前記カメラの露光タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記カメラの露光タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
前記(3)に記載の撮影システム。
(5)
前記露光時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
前記(4)に記載の撮影システム。
(6)
前記カメラの1フレーム期間における前記シャッタ装置の遮蔽時間は前記カメラの露光時間よりも長い
前記(5)に記載の撮影システム。
(7)
前記シャッタ装置は、前記プロジェクタの投射時間に合わせて、前記カメラへ入射する光を遮蔽する遮蔽時間を動的に変更する
前記(1)に記載の撮影システム。
(8)
前記プロジェクタのリフレッシュレートは前記カメラのフレームレートよりも大きい
前記(7)に記載の撮影システム。
(9)
前記プロジェクタの投射タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
前記(7)または(8)に記載の撮影システム。
(10)
前記プロジェクタの投射タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記プロジェクタの投射タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
前記(9)に記載の撮影システム。
(11)
前記プロジェクタの1リフレッシュ期間における前記シャッタ装置の遮蔽時間は前記プロジェクタの投射時間よりも長い
前記(7)ないし(10)のいずれか1つに記載の撮影システム。
(12)
前記投射時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
前記(11)に記載の撮影システム。
(13)
カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことを有する、コンピュータにより実行される撮影方法。
(14)
カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことをコンピュータに実現させるプログラム。 (1)
With the camera
With a projector
A shutter device that synchronizes with the camera or the projector and shields the light projected from the projector and incident on the camera.
Shooting system with.
(2)
The imaging system according to (1), wherein the shutter device dynamically changes the shielding time for shielding the light projected from the projector according to the exposure time of the camera.
(3)
It has a transmitter that transmits a signal indicating the exposure timing of the camera.
The imaging system according to (2), wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal.
(4)
During the period from when the exposure timing of the camera is changed until the shielding timing of the shutter device is synchronized with the exposure timing of the camera after the change, the projection of light by the projector is stopped in (3). Described shooting system.
(5)
The imaging system according to (4) above, wherein the shielding time is not changed when the fluctuation of the exposure time is within the threshold value.
(6)
The imaging system according to (5), wherein the shielding time of the shutter device in one frame period of the camera is longer than the exposure time of the camera.
(7)
The imaging system according to (1), wherein the shutter device dynamically changes the shielding time for shielding light incident on the camera according to the projection time of the projector.
(8)
The imaging system according to (7), wherein the refresh rate of the projector is larger than the frame rate of the camera.
(9)
It has a transmitter that transmits a signal indicating the projection timing of the projector.
The imaging system according to (7) or (8), wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal.
(10)
During the period from when the projection timing of the projector is changed until the shielding timing of the shutter device is synchronized with the projection timing of the projector after the change, the projection of light by the projector is stopped in (9). Described shooting system.
(11)
The imaging system according to any one of (7) to (10), wherein the shielding time of the shutter device in one refresh period of the projector is longer than the projection time of the projector.
(12)
The imaging system according to (11) above, wherein the shielding time is not changed when the fluctuation of the projection time is within the threshold value.
(13)
A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A method of shooting that is performed by a computer.
(14)
A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A program that makes a computer realize that.
カメラと、
プロジェクタと、
前記カメラまたは前記プロジェクタと同期し、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽するシャッタ装置と、
を有する撮影システム。
(2)
前記シャッタ装置は、前記プロジェクタから投射される光を遮蔽する遮蔽時間を前記カメラの露光時間に合わせて動的に変更する
前記(1)に記載の撮影システム。
(3)
前記カメラの露光タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
前記(2)に記載の撮影システム。
(4)
前記カメラの露光タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記カメラの露光タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
前記(3)に記載の撮影システム。
(5)
前記露光時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
前記(4)に記載の撮影システム。
(6)
前記カメラの1フレーム期間における前記シャッタ装置の遮蔽時間は前記カメラの露光時間よりも長い
前記(5)に記載の撮影システム。
(7)
前記シャッタ装置は、前記プロジェクタの投射時間に合わせて、前記カメラへ入射する光を遮蔽する遮蔽時間を動的に変更する
前記(1)に記載の撮影システム。
(8)
前記プロジェクタのリフレッシュレートは前記カメラのフレームレートよりも大きい
前記(7)に記載の撮影システム。
(9)
前記プロジェクタの投射タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
前記(7)または(8)に記載の撮影システム。
(10)
前記プロジェクタの投射タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記プロジェクタの投射タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
前記(9)に記載の撮影システム。
(11)
前記プロジェクタの1リフレッシュ期間における前記シャッタ装置の遮蔽時間は前記プロジェクタの投射時間よりも長い
前記(7)ないし(10)のいずれか1つに記載の撮影システム。
(12)
前記投射時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
前記(11)に記載の撮影システム。
(13)
カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことを有する、コンピュータにより実行される撮影方法。
(14)
カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことをコンピュータに実現させるプログラム。 (1)
With the camera
With a projector
A shutter device that synchronizes with the camera or the projector and shields the light projected from the projector and incident on the camera.
Shooting system with.
(2)
The imaging system according to (1), wherein the shutter device dynamically changes the shielding time for shielding the light projected from the projector according to the exposure time of the camera.
(3)
It has a transmitter that transmits a signal indicating the exposure timing of the camera.
The imaging system according to (2), wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal.
(4)
During the period from when the exposure timing of the camera is changed until the shielding timing of the shutter device is synchronized with the exposure timing of the camera after the change, the projection of light by the projector is stopped in (3). Described shooting system.
(5)
The imaging system according to (4) above, wherein the shielding time is not changed when the fluctuation of the exposure time is within the threshold value.
(6)
The imaging system according to (5), wherein the shielding time of the shutter device in one frame period of the camera is longer than the exposure time of the camera.
(7)
The imaging system according to (1), wherein the shutter device dynamically changes the shielding time for shielding light incident on the camera according to the projection time of the projector.
(8)
The imaging system according to (7), wherein the refresh rate of the projector is larger than the frame rate of the camera.
(9)
It has a transmitter that transmits a signal indicating the projection timing of the projector.
The imaging system according to (7) or (8), wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal.
(10)
During the period from when the projection timing of the projector is changed until the shielding timing of the shutter device is synchronized with the projection timing of the projector after the change, the projection of light by the projector is stopped in (9). Described shooting system.
(11)
The imaging system according to any one of (7) to (10), wherein the shielding time of the shutter device in one refresh period of the projector is longer than the projection time of the projector.
(12)
The imaging system according to (11) above, wherein the shielding time is not changed when the fluctuation of the projection time is within the threshold value.
(13)
A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A method of shooting that is performed by a computer.
(14)
A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A program that makes a computer realize that.
1,2,3,4 撮影システム
120,125,220,226 プロジェクタ
130,136,230 シャッタ装置
140,240 カメラ
150 送信機
PG プログラム 1,2,3,4 Shooting system 120, 125, 220, 226 Projector 130, 136, 230 Shutter device 140, 240 Camera 150 Transmitter PG program
120,125,220,226 プロジェクタ
130,136,230 シャッタ装置
140,240 カメラ
150 送信機
PG プログラム 1,2,3,4
Claims (14)
- カメラと、
プロジェクタと、
前記カメラまたは前記プロジェクタと同期し、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽するシャッタ装置と、
を有する撮影システム。 With the camera
With a projector
A shutter device that synchronizes with the camera or the projector and shields the light projected from the projector and incident on the camera.
Shooting system with. - 前記シャッタ装置は、前記プロジェクタから投射される光を遮蔽する遮蔽時間を前記カメラの露光時間に合わせて動的に変更する
請求項1に記載の撮影システム。 The imaging system according to claim 1, wherein the shutter device dynamically changes the shielding time for shielding the light projected from the projector according to the exposure time of the camera. - 前記カメラの露光タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
請求項2に記載の撮影システム。 It has a transmitter that transmits a signal indicating the exposure timing of the camera.
The imaging system according to claim 2, wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal. - 前記カメラの露光タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記カメラの露光タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
請求項3に記載の撮影システム。 The third aspect of claim 3, wherein the projection of light by the projector is stopped during the period from when the exposure timing of the camera is changed until the shielding timing of the shutter device is synchronized with the exposure timing of the camera after the change. Shooting system. - 前記露光時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
請求項4に記載の撮影システム。 The imaging system according to claim 4, wherein the shielding time is not changed when the fluctuation of the exposure time is within the threshold value. - 前記カメラの1フレーム期間における前記シャッタ装置の遮蔽時間は前記カメラの露光時間よりも長い
請求項5に記載の撮影システム。 The imaging system according to claim 5, wherein the shielding time of the shutter device in one frame period of the camera is longer than the exposure time of the camera. - 前記シャッタ装置は、前記プロジェクタの投射時間に合わせて、前記カメラへ入射する光を遮蔽する遮蔽時間を動的に変更する
請求項1に記載の撮影システム。 The imaging system according to claim 1, wherein the shutter device dynamically changes the shielding time for shielding light incident on the camera according to the projection time of the projector. - 前記プロジェクタのリフレッシュレートは前記カメラのフレームレートよりも大きい
請求項7に記載の撮影システム。 The imaging system according to claim 7, wherein the refresh rate of the projector is larger than the frame rate of the camera. - 前記プロジェクタの投射タイミングを示す信号を送信する送信機を有し、
前記シャッタ装置は、前記送信機から送信された前記信号を受信し、前記信号に基づいて前記遮蔽時間を制御する
請求項7に記載の撮影システム。 It has a transmitter that transmits a signal indicating the projection timing of the projector.
The imaging system according to claim 7, wherein the shutter device receives the signal transmitted from the transmitter and controls the shielding time based on the signal. - 前記プロジェクタの投射タイミングが変更されてから、前記シャッタ装置の遮蔽タイミングが変更後の前記プロジェクタの投射タイミングと同期するまでの期間中は、前記プロジェクタによる光の投射は停止される
請求項9に記載の撮影システム。 The ninth aspect of claim 9 is that the projection of light by the projector is stopped during the period from when the projection timing of the projector is changed until the shielding timing of the shutter device is synchronized with the projection timing of the projector after the change. Shooting system. - 前記プロジェクタの1リフレッシュ期間における前記シャッタ装置の遮蔽時間は前記プロジェクタの投射時間よりも長い
請求項7に記載の撮影システム。 The imaging system according to claim 7, wherein the shielding time of the shutter device in one refresh period of the projector is longer than the projection time of the projector. - 前記投射時間の変動が閾値以内である場合には、前記遮蔽時間は変更されない
請求項11に記載の撮影システム。 The imaging system according to claim 11, wherein the shielding time is not changed when the fluctuation of the projection time is within the threshold value. - カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことを有する、コンピュータにより実行される撮影方法。 A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A method of shooting that is performed by a computer. - カメラまたはプロジェクタと同期したシャッタ装置によって、前記プロジェクタから投射され前記カメラへ入射する光を遮蔽する、
ことをコンピュータに実現させるプログラム。 A shutter device synchronized with a camera or a projector shields light projected from the projector and incident on the camera.
A program that makes a computer realize that.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020042754A JP2021145233A (en) | 2020-03-12 | 2020-03-12 | Photography system, photography method, and program |
JP2020-042754 | 2020-03-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021182214A1 true WO2021182214A1 (en) | 2021-09-16 |
Family
ID=77671642
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2021/008096 WO2021182214A1 (en) | 2020-03-12 | 2021-03-03 | Photography system, photography method, and program |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2021145233A (en) |
WO (1) | WO2021182214A1 (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH04321395A (en) * | 1991-04-22 | 1992-11-11 | Nippon Telegr & Teleph Corp <Ntt> | Visual line coincidence display device |
JP2003319209A (en) * | 2002-04-26 | 2003-11-07 | Nippon Hoso Kyokai <Nhk> | Display device, illuminating device and photographing system |
JP2009188686A (en) * | 2008-02-05 | 2009-08-20 | Fuji Xerox Co Ltd | Image transmission apparatus, image transmission program, and image transmission system |
JP2013165480A (en) * | 2012-01-13 | 2013-08-22 | Dowango:Kk | Video system and photographing method |
KR101909897B1 (en) * | 2017-08-10 | 2018-10-19 | 성균관대학교산학협력단 | Method and apparatus for synchronizing between camera and projector |
-
2020
- 2020-03-12 JP JP2020042754A patent/JP2021145233A/en active Pending
-
2021
- 2021-03-03 WO PCT/JP2021/008096 patent/WO2021182214A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH04321395A (en) * | 1991-04-22 | 1992-11-11 | Nippon Telegr & Teleph Corp <Ntt> | Visual line coincidence display device |
JP2003319209A (en) * | 2002-04-26 | 2003-11-07 | Nippon Hoso Kyokai <Nhk> | Display device, illuminating device and photographing system |
JP2009188686A (en) * | 2008-02-05 | 2009-08-20 | Fuji Xerox Co Ltd | Image transmission apparatus, image transmission program, and image transmission system |
JP2013165480A (en) * | 2012-01-13 | 2013-08-22 | Dowango:Kk | Video system and photographing method |
KR101909897B1 (en) * | 2017-08-10 | 2018-10-19 | 성균관대학교산학협력단 | Method and apparatus for synchronizing between camera and projector |
Also Published As
Publication number | Publication date |
---|---|
JP2021145233A (en) | 2021-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9664376B2 (en) | Projection-type image display apparatus | |
JP6108946B2 (en) | Imaging apparatus, control method, program, and storage medium | |
EP2461592B1 (en) | A timing solution for projector camera devices and systems | |
JP6296697B2 (en) | Imaging apparatus, control method, program, and storage medium | |
US11284015B2 (en) | Image pickup apparatus capable of performing image pickup with reduced flicker influence, method for controlling the same, and storage medium | |
JPWO2006038577A1 (en) | Electronic apparatus having a projector device | |
KR20070082799A (en) | Display apparatus and method for displaying imagee | |
JP2007293195A (en) | Projector with automatic luminance adjustment mechanism, and automatic luminance adjustment method | |
JP2010008767A (en) | Optical unit and projection type video display | |
CN107635121A (en) | The projection brightness adjusting method of the projecting apparatus adaptively adjusted | |
WO2021182214A1 (en) | Photography system, photography method, and program | |
KR100686525B1 (en) | Projector-camera system and focusing method for augmented reality environment | |
JP2002344775A (en) | Illumination method, illuminator, display method, display device and photographing system | |
JP2006222637A (en) | Imaging apparatus | |
JPH10319506A (en) | Focusing device for projection television | |
JP6598927B2 (en) | Imaging apparatus, control method, program, and storage medium | |
JP5515907B2 (en) | Image display device | |
JP6704946B2 (en) | Imaging device, control method, program, and storage medium | |
JP2009206726A (en) | Projection video display device | |
JP2006276124A (en) | Multi-projection display | |
KR101049115B1 (en) | Multi-screen projection device | |
JP6351778B2 (en) | Imaging apparatus, control method, program, and storage medium | |
JP5887777B2 (en) | Projector and projector control method | |
JP2005099863A (en) | Projection type liquid crystal projector | |
CN115604442A (en) | Projection equipment and method for adjusting brightness of light source |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21768234 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21768234 Country of ref document: EP Kind code of ref document: A1 |