JP2015146611A - Interactive system and control method of interactive system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an interactive system which reduces situations in which information from a transmitter cannot be detected.SOLUTION: An interactive system 1 includes a plurality of projectors 100 and 200, a computer 300, and a transmitter (light-emitting pen 400) which transmits an optical signal. The plurality of projectors are installed so that projected images projected by respective projectors are displayed one over the other in one projection area. Each projector includes an imaging unit 50 or 250 which images a range including the projected image and forms first optical signal information based on an optical signal, and an optical signal output unit for outputting the optical signal to the computer 300. The computer 300 includes: an optical signal input unit which receives a plurality of pieces of first optical signal information; an optical signal information processing unit which forms second optical signal information on the basis of the plurality of pieces of first optical signal information; and an object operation unit which operates an object included in an image represented by an image signal, on the basis of the second optical signal information.

Description

  The present invention relates to an interactive system and a method for controlling the interactive system.

  Conventionally, when an image of a personal computer is projected onto a whiteboard by a projector and written with a marker having a transmission function such as infrared rays, the position is detected by a coordinate reading device equipped on the whiteboard, and the position and operation are detected by the personal computer. Interactive systems that can be incorporated into are known. Further, in such an interactive system, it is possible to cause a personal computer to execute a predetermined operation by clicking on the projection screen with a marker (for example, Patent Document 1).

  However, in such an interactive system, it is necessary to equip the whiteboard with a coordinate reading device, and there is a problem that it becomes a large-scale system. Therefore, an interactive system is known that includes an imaging device such as a camera in a projector, images and detects the position of a marker that emits infrared rays, and notifies a personal computer.

JP 2007-233999 A

  However, in an interactive system equipped with an imaging device in a projector, when a user inputs character or graphic information using a marker in front of the projection screen of the projector, the information transmitted from the marker is blocked by the user. In some cases, the imaging device (camera) cannot capture images. In such a case, there has been a problem that it is impossible to notify the personal computer of the marker position, locus, operation information, and the like.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 An interactive system according to this application example includes an interactive system including a plurality of projectors, a computer that supplies image signals to the plurality of projectors, and a transmitter that transmits an optical signal based on a predetermined operation. In the system, the plurality of projectors are installed so that projected images projected by each of the plurality of projectors are superimposed on the same projection area, and each of the plurality of projectors transmits light emitted from a light source to the image. An image projecting unit that modulates in accordance with a signal and projects the projected image on a projection surface; an image capturing unit that captures a range including the projected image and forms first optical signal information based on the optical signal; An optical signal output unit that outputs the first optical signal information to the computer. An optical signal input unit that inputs the first optical signal information from a projector, and an optical signal that forms second optical signal information based on the plurality of first optical signal information input by the optical signal input unit An information processing unit and an object operation unit that operates an object included in an image represented by the image signal based on the second optical signal information.

  Such an interactive system includes a plurality of projectors, a computer, and a transmitter. The plurality of projectors display the projected image superimposed on the same projection area. Each of the plurality of projectors includes an image projection unit, an imaging unit, and an optical signal output unit. An imaging part images the range containing a projection image, and forms the 1st optical signal information based on an optical signal. The optical signal output unit outputs the first optical signal information to the computer. The computer has an optical signal input unit, an optical signal information processing unit, and an object operation unit. The optical signal information processing unit forms second optical signal information based on the plurality of first optical signal information input to the optical signal input unit from the plurality of projectors. The object operation unit operates an object included in the image represented by the image signal based on the second optical signal information. As a result, the imaging unit of the projector can capture the range including the projected image from different directions, so when the user uses the transmitter in front of the projection area of the projector, the user is blocked by the user and transmits from the transmitter. It is possible to reduce the situation where the optical signal to be detected cannot be detected by the imaging unit. Then, the computer can operate the object based on the optical signal.

  Application Example 2 In the interactive system according to the application example, the optical signal information processing unit forms the second optical signal information by combining a plurality of the first optical signal information. And

  According to such an interactive system, even if there is a projector that cannot detect an optical signal among a plurality of projectors, the second optical signal information can be formed as long as at least one projector can be detected. Be beneficial.

  Application Example 3 An interactive system control method according to this application example includes: an image projection unit that modulates light emitted from a light source according to an image signal and projects the light onto a projection surface as a projection image; A plurality of projectors having an imaging unit that captures a range to include, a computer that supplies the image signals to the plurality of projectors, and a transmitter that transmits an optical signal based on a predetermined operation. Is a control method of an interactive system installed so that the projected images projected by each are superimposed on the same projection area, and each of the plurality of projectors includes the light captured by the imaging unit. An imaging step for forming first optical signal information based on the signal, and outputting the first optical signal information to the computer An optical signal output step, wherein the computer inputs the first optical signal information from the plurality of projectors, and the plurality of first signals input by the optical signal input step. An optical signal information processing step for forming second optical signal information based on the optical signal information of the object, and an object operation step for operating an object included in the image represented by the image signal based on the second optical signal information It is characterized by having.

  According to such an interactive system control method, since the imaging unit of the projector can capture a range including a projected image from different directions, when the user uses the transmitter in front of the projection area of the projector, It is possible to reduce the situation in which the imaging unit cannot detect an optical signal transmitted from the transmitter by being blocked by the user. Then, the computer can operate the object based on the optical signal.

Explanatory drawing which shows arrangement | positioning of the apparatus of the interactive system which concerns on embodiment. The figure which represents the projection image at the time of performing stack projection simply. The block diagram which shows the structure of an interactive system. The flowchart of the operation detection process of PC.

  Hereinafter, embodiments will be described.

(Embodiment)
In the present embodiment, an interactive system including a plurality of projectors having an imaging unit will be described.

FIG. 1 is an explanatory diagram showing an arrangement of devices of the interactive system according to the present embodiment.
FIG. 1 shows a mode in which the presenter H is giving a presentation. As shown in FIG. 1, the interactive system 1 of this embodiment includes a projector 100, a projector 200, a personal computer (PC) 300 as a computer, a light-emitting pen 400 as a transmitter that transmits an optical signal, and light emission. A presenter H holding the pen 400 and a projection surface S such as a whiteboard are shown.

  The projector 100 includes a projection lens 13 and an imaging unit 50 including a CCD (Charge Coupled Device) camera or the like. The projected image projected from the projection lens 13 is projected onto the projection plane S. The imaging unit 50 captures a range including a projected image. Here, the projected image light is represented by a broken line, and the imaging range is represented by an alternate long and short dash line. Similarly, the projector 200 includes a projection lens 213 and an imaging unit 250. The projected image projected from the projection lens 213 is projected on the projection plane S. The imaging unit 250 captures a range including a projected image. Here, the projector 100 and the projector 200 are installed so as to superimpose on the same projection area on the projection surface S from different directions and display a projected image, that is, stack projection. Then, the projector 100 and the projector 200 respectively capture the range including the projected images that are stacked.

  The PC 300 is connected to the projector 100 via the image cable C1 and the communication cable C3. The PC 300 is connected to the projector 200 via the image cable C2 and the communication cable C4. The PC 300 outputs an image signal to the projector 100 via the image cable C1, and outputs the same image signal to the projector 200 via the image cable C2. Further, the PC 300 receives information about the captured image from the projector 100 via the communication cable C3, and receives information about the captured image from the projector 200 via the communication cable C4. In this embodiment, the image cables C1 and C2 are analog RGB cables, and the communication cables C3 and C4 are USB (Universal Serial Bus) cables. Note that the types of the image cable and the communication cable may be other types of cables.

Here, stack projection will be described.
FIG. 2 is a diagram simply showing a projected image when stack projection is performed.

  A state in which two projectors 100 and 200 are superimposed on the same projection area on the projection surface S from different directions as shown in FIG. 1 to display a projection image, that is, a stack projection state will be described. Here, the projector 100 and the projector 200 project the same rectangular image. Then, since the projection is performed from the oblique direction with respect to the projection surface S, the image projected from the projector 100 becomes a distorted quadrilateral as in the projection image G1, as shown in FIG. Similarly, the image projected from the projector 200 becomes a quadrangle distorted in the opposite direction to the projected image G1, as in the projected image G2. Further, the imaging area P1 of the projector 100 is also a distorted quadrilateral, and the imaging area P2 of the projector 200 is also a distorted quadrilateral.

  The PC 300 calculates a rectangular portion of the region where the projection image G1 and the projection image G2 are superimposed as a superimposed image region G3. This process is called a stack projection calibration process. The PC 300 instructs the projector 100 and the projector 200 to perform image correction processing so that an image based on the input image is formed on the superimposed image region G3 calculated by the stack projection calibration processing. .

  Further, the PC 300 generates a coordinate conversion formula for converting the coordinates on the imaging region P1 and the imaging region P2 to the coordinates on the superimposed image region G3. By using this coordinate conversion formula, the interactive system 1 can detect the position information (coordinates) of the light-emitting pen 400 operated on the superimposed image region G3. Instead of the coordinate conversion formula, a conversion table (not shown) for coordinate conversion may be generated.

FIG. 3 is a block diagram showing a configuration of the interactive system 1 according to the present embodiment.
As shown in FIG. 3, the interactive system 1 includes a projector 100, a projector 200, a PC 300, a light emitting pen 400, and a projection surface S.

  The projector 100 includes an image projection unit 10, a control unit 20, an operation reception unit 21, a light source control unit 22, an image signal input unit 31, an image processing unit 32, an OSD (on-screen display) processing unit 33, an imaging unit 50, and an optical signal. An output unit 51 and the like are provided.

  The image projection unit 10 includes a light source 11, three liquid crystal light valves 12R, 12G, and 12B as light modulation devices, a projection lens 13 as a projection optical system, a light valve drive unit 14, and the like. The image projection unit 10 modulates the light emitted from the light source 11 with the liquid crystal light valves 12R, 12G, and 12B to form image light. The image light is projected from the projection lens 13 and displayed on the projection surface S or the like. To do.

  The light source 11 includes a discharge-type light source lamp 11a made of an ultra-high pressure mercury lamp, a metal halide lamp, or the like, and a reflector 11b that reflects light emitted from the light source lamp 11a toward the liquid crystal light valves 12R, 12G, and 12B. ing. The light emitted from the light source 11 is converted into light having a substantially uniform luminance distribution by an integrator optical system (not shown), and each color light of red R, green G, and blue B, which are the three primary colors of light, by a color separation optical system (not shown). After being separated into components, they are incident on the liquid crystal light valves 12R, 12G, and 12B, respectively.

  The liquid crystal light valves 12R, 12G, and 12B are configured by a liquid crystal panel in which liquid crystal is sealed between a pair of transparent substrates. In the liquid crystal light valves 12R, 12G, and 12B, a plurality of pixels (not shown) arranged in a matrix are formed, and a driving voltage can be applied to the liquid crystal for each pixel. When the light valve driving unit 14 applies a driving voltage corresponding to the input image information to each pixel, each pixel is set to a light transmittance corresponding to the image information. For this reason, the light emitted from the light source 11 is modulated by transmitting through the liquid crystal light valves 12R, 12G, and 12B, and an image corresponding to the image information is formed for each color light. The formed color images are synthesized for each pixel by a color synthesis optical system (not shown) to form a color image, and then projected from the projection lens 13.

  The control unit 20 includes a CPU (Central Processing Unit), a RAM used for temporary storage of various data, and a non-volatile memory such as a mask ROM, flash memory, FeRAM (Ferroelectric RAM), etc. (Not shown) and functions as a computer. The control unit 20 performs overall control of the operation of the projector 100 by the CPU operating according to a control program stored in a nonvolatile memory.

  The operation receiving unit 21 receives an input operation from the user, and includes a plurality of operation keys for the user to give various instructions to the projector 100. The operation keys provided in the operation accepting unit 21 are a power key for switching power on / off, a menu key for switching display / non-display of a menu screen for performing various settings, and a cursor movement on the menu screen. Cursor keys to be displayed, determination keys for determining various settings, and the like. When the user operates (presses) various operation keys of the operation receiving unit 21, the operation receiving unit 21 receives this input operation and outputs an operation signal corresponding to the operation content of the user to the control unit 20. The operation receiving unit 21 may be configured using a remote control (not shown) capable of remote operation. In this case, the remote controller transmits an operation signal such as an infrared ray corresponding to the operation content of the user, and a remote control signal receiving unit (not shown) receives this and transmits it to the control unit 20.

  The light source control unit 22 performs an insulation breakdown between electrodes of an inverter (not shown) that converts a direct current generated by a power supply circuit (not shown) into an alternating current rectangular wave current and an electrode of the light source lamp 11a. An igniter (not shown) for urging the start of 11a is provided, and lighting of the light source 11 is controlled based on an instruction from the control unit 20. Specifically, the light source control unit 22 can turn on the light source 11 by starting the light source 11 and supplying predetermined power, and can stop the supply of power and turn off the light source 11. The light source control unit 22 can adjust the luminance (brightness) of the light source 11 by controlling the power supplied to the light source 11 based on an instruction from the control unit 20.

  The image signal input unit 31 is provided with an input terminal (not shown) for connection with the PC 300 via the image cable C1, and an image signal is input from the PC 300. The image signal input unit 31 converts the input image signal into image information in a format that can be processed by the image processing unit 32, and outputs the image information to the image processing unit 32.

  The image processing unit 32 converts the image information input from the image signal input unit 31 into image data representing the gradation of each pixel of the liquid crystal light valves 12R, 12G, and 12B. Here, the converted image data is for each color light of R, G, B, and is composed of a plurality of pixel values corresponding to all the pixels of each liquid crystal light valve 12R, 12G, 12B. The pixel value determines the light transmittance of the corresponding pixel, and the intensity (gradation) of light emitted from each pixel is defined by the pixel value. The image processing unit 32 performs image quality adjustment processing for adjusting brightness, contrast, sharpness, hue, and the like on the converted image data based on an instruction from the control unit 20, and the processed image data Is output to the OSD processing unit 33.

  The OSD processing unit 33 performs processing for superimposing an OSD image such as a menu screen or a message screen on image data input from the image processing unit 32 based on an instruction from the control unit 20. The OSD processing unit 33 includes an OSD memory (not shown), and stores OSD image data representing graphics, fonts, and the like for forming an OSD image. When the control unit 20 instructs to superimpose an OSD image, the OSD processing unit 33 reads necessary OSD image data from the OSD memory, and the image processing unit 32 so that the OSD image is superimposed at a predetermined position of the input image. The OSD image data is synthesized with the image data input from the. The image data combined with the OSD image data is output to the light valve driving unit 14. When there is no instruction to superimpose the OSD image from the control unit 20, the OSD processing unit 33 outputs the image data output from the image processing unit 32 to the light valve driving unit 14 as it is.

  When the light valve driving unit 14 drives the liquid crystal light valves 12R, 12G, and 12B according to the image data input from the OSD processing unit 33, the liquid crystal light valves 12R, 12G, and 12B form images according to the image data, This image is projected from the projection lens 13.

  The imaging unit 50 includes an imaging element (not shown) including a CCD sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, and an imaging lens (not shown) for imaging light emitted from an imaging target on the imaging element. (Not shown). The imaging unit 50 is disposed in the vicinity of the projection lens 13 of the projector 100 and images a range including an image (projected image) projected on the projection surface S at a predetermined frame rate. In the present embodiment, the imaging unit 50 can capture infrared light. Then, the imaging unit 50 sequentially generates optical signal image information representing the captured infrared light image (captured image) and outputs the optical signal image information from the optical signal output unit 51. Here, the optical signal image information corresponds to the first optical signal information. Note that in the stack projection calibration process, the imaging unit 50 can capture visible light.

  The optical signal output unit 51 outputs optical signal image information captured by the imaging unit 50 to the PC 300 via a communication cable C3 using a predetermined communication unit. In this embodiment, the communication means used by the optical signal output unit 51 is a communication means using USB. The communication means used by the optical signal output unit 51 is not limited to the USB, and other communication means may be used.

  The projector 200 has the same configuration as the projector 100. Therefore, the description is omitted.

  The light-emitting pen 400 includes a push switch and a light-emitting diode that emits infrared light at the tip (pen tip) of a pen-shaped main body. When the user performs an operation (pressing operation) of pressing the pen tip of the light emitting pen 400 against the projection surface S and presses the pressing switch, the light emitting diode emits light.

  The PC 300 includes an optical signal input unit 310, an optical signal information conversion unit 320, an optical signal information processing unit 330, an operation unit 340, a CPU 350, a memory 360, and an image output unit 370. Here, the optical signal information processing unit 330, the operation unit 340, the CPU 350, the memory 360, and the image output unit 370 are connected to each other via the bus B.

  The optical signal input unit 310 inputs optical signal image information from the projector 100 via a communication cable C3 using a predetermined communication unit. The optical signal input unit 310 inputs optical signal image information from the projector 200 via the communication cable C4. In this embodiment, the communication means used by the optical signal input unit 310 is a communication means using USB. The communication means used by the optical signal output unit 51 is not limited to the USB, and other communication means may be used.

  The optical signal information conversion unit 320 includes a coordinate conversion information storage unit 320a. The coordinate conversion information storage unit 320a stores a coordinate conversion formula for converting the coordinates on the imaging region P1 and the imaging region P2 described above to the coordinates on the superimposed image region G3. The optical signal information conversion unit 320 converts the optical signal image information input to the optical signal input unit 310 into position information (coordinates) on the superimposed image region G3 based on the coordinate conversion formula stored in the coordinate conversion information storage unit 320a. Convert to Specifically, based on the optical signal image information, it is determined whether or not the light emitting pen 400 emits light within the image. When light is emitted, the position of light emission, that is, position information (coordinates) where a pressing operation is performed in the captured image is detected. When detecting the emitted position information (coordinates), the optical signal information conversion unit 320 converts the position information on the captured image into position information (coordinates) on the superimposed image region G3 using a coordinate conversion formula.

  The optical signal information processing unit 330 includes position information (coordinates) on the superimposed image region G3 based on the optical signal image information input from the projector 100, and the superimposed image region G3 based on the optical signal image information input from the projector 200. The position information (coordinates) is synthesized and recognized as light position information representing the light emission position. The optical position information corresponds to the second optical signal information. Further, the optical signal information processing unit 330 changes the transmission pattern (light emission pattern) of the light-emitting pen 400 based on the optical signal image information input from the projector 100 and the optical signal image information input from the projector 200. Recognize as information.

  The operation unit 340 includes a keyboard, a mouse, and the like for giving various instructions to the PC 300. The memory 360 stores software (device driver) for using the light-emitting pen 400 like a pointing device. In a state where this software is activated, the PC 300, based on the optical position information based on the optical signal image information input from the projectors 100 and 200, the position where the light emitting pen 400 emits light in the projected image, that is, in the projected image. The position where the pressing operation is performed is recognized. Then, the object included in the image is operated. The CPU 350 that performs the software operation of the PC 300 at this time corresponds to the object operation unit. When the PC 300 recognizes the light emission position, the PC 300 performs the same processing as when a click operation is performed with the pointing device at this position. That is, the user can give the same instruction to the PC 300 with the pointing device by performing a pressing operation with the light emitting pen 400 in the projected image.

  The image output unit 370 outputs an image signal based on the image to the projector 100 and the projector 200.

Next, operation detection processing of the light emitting pen 400 performed by the PC 300 of the interactive system 1 will be described.
FIG. 4 is a flowchart of the operation detection process of the PC 300.

  When the optical signal image information is input from the projectors 100 and 200 to the optical signal input unit 310 of the PC 300, the optical signal information conversion unit 320 converts the input optical signal image information into a superimposed image region G3 based on a coordinate conversion formula. The position information is converted into the upper position information (step S101).

  The optical signal information processing unit 330 combines position information based on the optical signal image information input from the projector 100 and position information based on the optical signal image information input from the projector 200 (step S102). By combining in this way, when the optical signal of the light emitting pen 400 is not detected in one of the two optical signal image information input from the projector 100 and the projector 200 and the optical signal is detected in the other one, The optical signal information processing unit 330 can recognize the optical signal information.

  The optical signal information processing unit 330 recognizes the optical position information obtained by detecting the optical signal of the light emitting pen 400 based on the synthesized position information (step S103). Furthermore, the optical signal information processing unit 330 recognizes the transmission pattern information of the light emitting pen 400 (step S104).

  Then, CPU 350 operates an object included in the image based on the light position information and the transmission pattern information (step S105). Here, the operation of the object represents the same processing as that when the click operation is performed by the pointing device at the position on the image represented by the light position information. And the operation detection process of PC300 is complete | finished.

According to the embodiment described above, the following effects can be obtained.
(1) The projector 100 and the projector 200 of the interactive system 1 display the projected image superimposed on the same projection area, and each imaging unit 50 captures a range including the projected image as optical signal image information. Output to PC300. The PC 300 forms position information based on the optical signal image information input from the projector 100 and the projector 200. Thus, since the projectors 100 and 200 can capture the range including the projected image from different directions, when the presenter H uses the light-emitting pen 400 in front of the projection area of the projector, one captured image is blocked. Even in this case, the pen input operation by the light emitting pen 400 can be detected using the other captured image. Therefore, it is possible to reduce the situation in which the information on the optical signal transmitted from the light emitting pen 400 by being blocked by the presenter H cannot be captured by the imaging unit 50.

  (2) The PC 300 of the interactive system 1 combines position information based on optical signal image information input from the projector 100 and the projector 200. The PC 300 recognizes the light position information and the transmission pattern information detected from the light signal of the light-emitting pen 400 based on the combined position information. Then, the PC 300 operates an object included in the image based on the light position information and the transmission pattern information. As a result, if at least one of the projector 100 and the projector 200 is able to capture an imaging region, the PC 300 includes the positional information, and is included in the image based on the optical positional information and the transmission pattern information. This is beneficial because it can manipulate objects.

  In addition, it is not limited to embodiment mentioned above, It is possible to implement by adding various change, improvement, etc. A modification will be described below.

  (Modification 1) In the above embodiment, the interactive system 1 includes two projectors having an imaging unit. However, the number of projectors having an imaging unit is not limited to this, and may be two or more. Good.

  (Modification 2) In the above embodiment, the PC 300 performs composition of position information based on the optical signal image information of the projector 100 and the projector 200. However, without synthesizing the position information, the presence or absence of the light signal of the light-emitting pen 400 is determined based on the position information based on the light signal image information of one projector, and when the light signal is not detected, The optical signal may be detected using position information based on the optical signal image information of the projector.

  (Modification 3) In the above embodiment, the optical signal information conversion unit 320 and the optical signal information processing unit 330 are described as independent components, but may be configured to be built in the memory 360 as a program. The CPU 350 executes the program in the memory 360 to perform processing for converting light signal image information into position information, position information synthesis processing, light position information recognition processing, transmission pattern information recognition processing, and the like. May be.

  (Modification 4) In the above-described embodiment, a mode in which an operation is performed on a projected image using the light-emitting pen 400 that emits infrared light has been described. However, the present invention is not limited to this mode. It is good also as a mode which performs.

  (Modification 5) In the above-described embodiment, the light source 11 of the projectors 100 and 200 is constituted by the discharge-type light source lamp 11a. However, a solid-state light source such as an LED (Light Emitting Diode) light source or a laser, or other light source. Can also be used.

  (Modification 6) In the above embodiment, the transmissive liquid crystal light valves 12R, 12G, and 12B are used as the light modulation devices of the projectors 100 and 200. However, the reflective light modulation such as a reflective liquid crystal light valve is used. It is also possible to use a device. In addition, it is possible to use a micromirror array device that modulates light emitted from a light source by controlling the emission direction of incident light for each micromirror as a pixel.

  DESCRIPTION OF SYMBOLS 1 ... Interactive system, 10 ... Image projection part, 11 ... Light source, 11a ... Light source lamp, 11b ... Reflector, 12R, 12G, 12B ... Liquid crystal light valve, 13 ... Projection lens, 14 ... Light valve drive part, 20 ... Control part , 21 ... Operation accepting part, 22 ... Light source control part, 31 ... Image signal input part, 32 ... Image processing part, 33 ... OSD processing part, 50 ... Imaging part, 51 ... Optical signal output part, 100, 200 ... Projector, 213 ... Projection lens, 250 ... Imaging unit, 300 ... PC, 310 ... Optical signal input unit, 320 ... Optical signal information conversion unit, 320a ... Coordinate conversion information storage unit, 330 ... Optical signal information processing unit, 340 ... Operation unit, 350 ... CPU, 360 ... memory, 370 ... image output unit, 400 ... light emitting pen.

Application Example 1 the interactive system according to this application example, the first camera, and the first different second camera and the camera, and the projector, and computer supplies an image signal to the projector, the predetermined a transmitter for transmitting a basis optical signal to the operation, an optical signal output unit for outputting an optical signal information based on the optical signal, a interactive system wherein the projector, light emitted from the light source An image projection unit that modulates the image according to the image signal and projects the projected image onto a projection surface, and the first camera and the second camera each capture a range including the projection image. Accordingly, to form a first optical signal information based on the optical signal,
The optical signal output section, said first optical signal information to output to the computer, the computer, an optical signal input unit for inputting the first optical signal information from the optical signal output section, said first It is determined whether or not the optical signal is present in the first optical signal information formed by one camera. If it is determined that the optical signal is present, the first light formed by the first camera is determined. Second optical signal information is formed based on the signal information, and when it is determined that the optical signal does not exist, the second optical signal is formed based on the first optical signal information formed by the second camera. An optical signal information processing unit that forms information, and an object operation unit that operates an object included in an image represented by the image signal based on the second optical signal information.

According to such an interactive system, since the first camera and the second camera can capture a range including a projected image from different directions, the user uses the transmitter in front of the projection area of the projector. In addition, it is possible to reduce the situation in which the imaging unit cannot detect the optical signal transmitted from the transmitter by being blocked by the user. Then, the computer can operate the object based on the optical signal.

Application Example 3] The method of an interactive system according to this application example, by modulating the light emitted from the light source to an image signal, and a projector having an image projection section that projects the projection plane as a projected image, An interactive system comprising: a first camera and a second camera that capture a range including the projected image; a computer that supplies the image signal to the projector; and a transmitter that transmits an optical signal based on a predetermined operation. A method of controlling a system, wherein an imaging step of forming first optical signal information based on the optical signal captured by the first camera and the second camera, and the first optical signal information as the computer an optical signal output step of outputting, the computer said first optical signal information from said first camera and said second camera input to To the optical signal input step, said whether the optical signal is present is determined in the first optical signal information input from the first camera, when it is determined that the optical signal is present the first second to form a light signal information based on the first optical signal information inputted from the camera, if it is determined that the optical signal is not present the first optical signal information inputted from said second camera An optical signal information processing step for forming the second optical signal information based on the information, and an object operation step for operating an object included in the image represented by the image signal based on the second optical signal information. It is characterized by that.

According to such an interactive system control method, since the first camera and the second camera can capture a range including a projected image from different directions, the user can transmit the transmitter in front of the projection area of the projector. When using this, it is possible to reduce the situation in which the imaging unit cannot detect the optical signal transmitted from the transmitter by being blocked by the user. Then, the object can be operated based on the optical signal.

Claims (2)

A plurality of projectors including a first projector and a second projector different from the first projector; a computer that supplies image signals to the plurality of projectors; and a transmitter that transmits an optical signal based on a predetermined operation; , An interactive system comprising
The plurality of projectors are installed so that projection images projected by the projectors are superimposed on the same projection area and displayed.
Each of the plurality of projectors is
An image projection unit that modulates light emitted from a light source according to the image signal and projects the light onto the projection surface as the projection image;
An imaging unit that captures a range including the projected image and forms first optical signal information based on the optical signal;
An optical signal output unit for outputting the first optical signal information to the computer;
Have
The computer
An optical signal input unit for inputting the first optical signal information from the plurality of projectors;
It is determined whether or not the optical signal is present in the first optical signal information input from the first projector. If it is determined that the optical signal is present, the first optical signal input from the first projector is determined. Second optical signal information is formed based on the optical signal information of the second optical signal, and when it is determined that the optical signal does not exist, the second optical signal information is input based on the first optical signal information input from the second projector. An optical signal information processing unit for forming optical signal information;
An object operation unit that operates an object included in an image represented by the image signal based on the second optical signal information;
An interactive system characterized by comprising: A plurality of projectors each including an image projection unit that modulates light emitted from a light source according to an image signal and projects the light onto a projection plane as a projection image; and an imaging unit that captures a range including the projection image; A computer for supplying the image signal to the projector and a transmitter for transmitting an optical signal based on a predetermined operation, wherein the plurality of projectors superimpose the projection images projected by the projector on the same projection area. Control method of interactive system installed to display
The plurality of projectors includes a first projector and a second projector different from the first projector, and each of the plurality of projectors includes:
An imaging step of forming first optical signal information based on the optical signal captured by the imaging unit;
An optical signal output step of outputting the first optical signal information to the computer;
Have
The computer
An optical signal input step of inputting the first optical signal information from the plurality of projectors;
It is determined whether or not the optical signal is present in the first optical signal information input from the first projector. If it is determined that the optical signal is present, the first optical signal input from the first projector is determined. Second optical signal information is formed based on the optical signal information of the second optical signal, and when it is determined that the optical signal does not exist, the second optical signal information is input based on the first optical signal information input from the second projector. An optical signal information processing step for forming optical signal information;
An object operation step of operating an object included in an image represented by the image signal based on the second optical signal information;
A control method for an interactive system, comprising:

Images