JP2018010602A - Projection device, multi-projection system, and position identifying method of multi-projection system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projection device which properly identify write position information of an electronic pen, in an area where projection images projected from a plurality of projection devices overlap each other.SOLUTION: A projection device to be applied to a multi-projection system is connected to an information processing terminal, an electronic pen, and each of projection devices, over a network. The projection device includes: a communication section which outputs a write position transmitted from an electronic pen to the information processing terminal; light-emitting means which emits light; and a color wheel including a plurality of areas so as to time-divide the projected light into a plurality of colors by rotation, specifying a projection device projecting a partial image including a written portion, specifying a position of the partial image, and embedded so that position detection patterns with priority including priority information of projection devices in specifying the above projection device may be set in different positions between the projection devices, in the portion where images projected from two or more projection devices overlap each other.SELECTED DRAWING: Figure 17

Description

  The present invention relates to a projection apparatus, a multi-projection system, and a position specifying method for the multi-projection system.

  Conventionally, the projector and the electronic pen can be interactively (mutually) capable of writing characters, figures, etc. by moving the electronic pen on the projection surface on which the image is projected by the projector, and writing the writing locus into the information processing terminal. (Operation) Technology is known (for example, Patent Document 1).

  In addition, a multi-projection system (also referred to as a multi-display system or a multi-screen system) that projects a large image by arranging a plurality of projectors adjacent to each other for signage systems such as advertisements and educational purposes ( For example, Patent Document 2).

  However, the above-described interactive technology is set assuming that the projector (projection device), the electronic pen, and the information processing terminal correspond to each other, and the projection images are connected to each other to connect a plurality of projection devices. It could not be applied to the multi-projection system used.

  In particular, in a multi-projection system, in order to eliminate a display gap on the projection plane, a part (edge) of an image projected from one projection device and an edge of an image projected from an adjacent projection device are: The images are overlapping. For this reason, the position information for writing with the electronic pen cannot be correctly identified in the overlapping area.

  Therefore, in view of the above circumstances, an object of the present invention is to provide a projection device that can correctly identify position information for writing with an electronic pen in a region where projection images projected from a plurality of projection devices overlap.

In order to solve the above problems, one embodiment of the present invention includes the following means.
In one aspect, a plurality of projection devices that project an image, an electronic pen that is writable on the projected image, output projection image data to the projection device, and writing on the projected image by the electronic pen A projection apparatus applicable to a multi-projection system having an information processing terminal capable of reflecting the projected image data on the projection image data,
The projector is
A communication unit that is connected to each of the information processing terminal, the electronic pen, and each of the plurality of projection apparatuses via a network, and that outputs a writing position transmitted from the electronic pen to the information processing terminal;
A light emitting means for projecting light; and a plurality of areas so as to time-divide the projected light into a plurality of colors by rotation; Priority including information on priority between the projection devices when the projection device is specified, the position on the partial image is specified, and the images projected from two or more projection devices overlap each other. An embedded color wheel so that a position detection pattern with a degree is set at different positions among the plurality of projection devices;
A projection device is provided.

  According to one aspect, in the projection device, the position information of writing of the electronic pen can be correctly identified in the region where the projection images projected from the plurality of projection devices overlap.

The schematic diagram which shows an example of schematic structure of the multi-projection system which concerns on embodiment of this invention. 1 is a block diagram showing an example of a configuration of a multi-projection system according to an embodiment of the present invention. 1 is a control block diagram of an example of a projector according to an embodiment of the invention. Explanatory drawing which shows the optical path in the image | video projection part of the projector which concerns on embodiment of this invention. The block diagram which shows an example of the filter of the color wheel contained in the image projection part of FIG. FIG. 3 is an explanatory diagram illustrating an example of the vicinity of the tip of the electronic pen in FIG. 2. Explanatory drawing of an example of the projection timing of a pattern image. Explanatory drawing of an example of the detection method of the designated position embedded in the white pattern. 2 is a schematic configuration example of a multi-projection system of a comparative example. The figure explaining the rotation timing of the color wheel in a some projector in the comparative example of FIG. 1 is an overall perspective view illustrating a setting method of a multi-projection system according to an embodiment of the present invention. 5 is a control flowchart for controlling the number of rotations of a color wheel in a plurality of projectors in an embodiment of the present invention. The figure explaining synchronous control of the rotation timing of the color wheel between the some projector in embodiment of this invention. An example of schematic structure in the case of providing overlap of screens in the multi-projection system of FIG. Explanatory drawing of the overlap of several screens of the image displayed in FIG. The example of the control flowchart in the positional information detection of embodiment of this invention. The example which embedded the position detection pattern in the color wheel of each projector of embodiment of this invention in the green area | region. (A) Example of data stored for position detection by a plurality of projectors, (b) Example of priority data embedded in an electronic pen.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

  FIG. 1 is a schematic diagram illustrating an example of a schematic configuration of a multi-projection system 1 according to an embodiment of the present invention.

  The multi-projection system 1 includes a control terminal 10, a plurality of projection devices 20-1 to 20-6, and an electronic pen 30.

  The plurality of projection devices 20-1 to 20-6 project images onto the screens 40-1 to 40-6. Specifically, each of the projection devices 20-1, 20-2, 20-3, 20-4, 20-5, and 20-6 of the plurality of projection devices is projected from the plurality of projection devices 20-1 to 20-6. The partial images constituting a part of the whole projection image are projected so that the projection images gathered to form one whole projection image as a whole.

  The electronic pen 30 is an example of a handwriting input device, and can write on images projected onto the screens 40-1 to 40-6.

  The control terminal (information processing terminal) 10 can output the projection image data to the plurality of projection devices 20-1 to 20-6, and can reflect the writing by the electronic pen 30 on the projected image on the projection image data. .

  The control terminal 10, each of the plurality of projection devices 20-1 to 20-6, and the electronic pen 30 are connected via a network. Examples of the network include Wireless USB (Universal Serial Bus) and Bluetooth (registered trademark). However, the connection form is not limited to wireless connection, but may be connection with a communication cable using a standard such as a wired LAN (Local Area Network), IEEE 1394, or USB.

  FIG. 2 is a block diagram showing an example of the configuration of the multi-projection system 1 according to the embodiment of the present invention. In FIG. 2, the internal configuration is described using the projection device 20-1 among the plurality of projection devices 20-1 to 20-6, but the other projection devices 20-2 to 20-6 have the same configuration. It is.

  First, the control terminal 10 will be described. As shown in FIG. 2, the control terminal 10 includes a data processing unit 110, a communication unit 120, a display unit 130, a video input unit 140, an HDD (Hard Disk Drive) 150, and an operation unit 160. Yes.

  The data processing unit 110 includes a CPU 111, a ROM (Read Only Memory) 112, and a RAM (Random Access Memory) 113. While using various programs stored in the ROM 112 and the RAM 113 as a work area, the CPU 111 converts image data (content data) into streaming data (projected image data).

  The image data may be input from the video input unit 140 such as a USB connector, or may be stored in the control terminal 10. The HDD 150 is a storage medium that stores projection image data projected onto the projection apparatus 20-6, data such as content, and programs.

  The communication unit 120 performs wireless communication with an external device such as the projection device 20 to transmit / receive desired data as a packet. Specifically, the communication unit 120 transmits the image data of the projection image to the plurality of projection devices 20-1 to 20-6. Further, the communication unit 120 receives coordinate data specified by the designated position information indicating the designated position of the electronic pen 30 with respect to the projection image from any of the projection devices 20-1 to 20-6.

  The operation unit 160 is a keyboard, a mouse, or the like that receives an operation input from a user.

  The display unit 130 is a display that displays image data, an operation screen, and the like. Based on the coordinate data of writing by the electronic pen 30 on the projected image, the writing can be reflected on the projected image data of the display unit 130 and displayed.

  In addition, the control terminal 10 includes a power supply unit, an audio output unit, and the like.

  Next, the projection device (projector, display device) 20 will be described. As shown in FIG. 2, each of the projection devices 20-1 to 20-6 includes a data processing unit 210, a communication unit 220, a video projection unit 230, an input unit 240, an audio output unit 250, and an operation unit 260. And. The input unit 240 may be a part of the communication unit 220.

  Projection image data is input from the control terminal 10 to the input unit 240 in the case of wired connection, and to the communication unit 220 in the case of wireless connection.

  The data processing unit 210 includes a DLP (digital light processing) controller 211, a ROM 212, and a RAM 213. The DLP controller 211 executes a program stored in the ROM 212, and controls each unit of the projection apparatus 20-1 using the RAM 213 as a work area. Specific functions will be described later with reference to FIG. The data processing unit 210 converts packet data from the network into projection video and audio.

  The video projection unit 230 emits projection light and is received by the communication unit 220 or the input unit 240 from the control terminal 10, and the image data subjected to various image processing by the data processing unit 210 is applied to the projection medium 40 such as a screen. Project as a projected image. In addition, when projecting a projection image, the video projection unit 230 also appropriately projects a pattern image (see FIGS. 8 and 9) used when the electronic pen 30 detects the designated position.

  The sound output unit 250 is a speaker or the like that outputs sound when projecting a projection image.

  The communication unit 220 is connected to the control terminal 10, the electronic pen 30, and each of the plurality of projection devices (20-3, 20-4) via a network, and performs communication to transmit / receive desired data. is there. Specifically, the communication unit 220 receives the designated position information from the electronic pen 30, and transmits the coordinate data specified by the designated position information indicating the designated position of the electronic pen 30 in the projection image to the control terminal 10.

  In addition to the above configuration, the projection devices 20-1 to 20-6 appropriately include a power supply device, a cooling unit, and the like.

  Next, the electronic pen 30 will be described. As shown in FIG. 2, the electronic pen 30 includes a data processing unit 310, a communication unit 320, a pen tip switch 31, and a camera 32.

  The camera 32 (an example of an imaging unit) detects a writing position (a position indicated by the pen tip, a locus position) where the electronic pen 30 writes the projection image projected on the projection medium 40.

  The pen tip switch 31 is a switch provided in the vicinity of the camera 32 near the tip of the electronic pen 30. The pen tip switch 31 detects that the projection image is pressed (pressed) on a projection medium such as a screen on which the projection image is projected.

  The data processing unit 310 includes a CPU 311, a ROM 312 and a RAM 313. The CPU 311 performs various processes such as various programs stored in the ROM 312 using the RAM 313 as a work area. The data processing unit 310 functions as a position specifying unit, extracts position identification information from a photographed image of a writing part indicated by the electronic pen 30, specifies a writing position, and specifies the specified writing position. Is converted into writing position information (instructed position information) to be transmitted to a projection apparatus (self-projection apparatus) 20 that projects a partial image including.

  The communication unit (transmission unit) 320 performs wireless communication with the projection device 20-1 and transmits / receives desired data. In the present embodiment, the communication unit 320 transmits instruction position information indicating a writing position to be written by the electronic pen 30 to any of the projection devices 20-1 to 20-6. Details of which projection apparatus is transmitted will be described later with reference to FIGS.

  In addition, the electronic pen 30 appropriately includes a battery (main power source), a photoelectric conversion unit (auxiliary power source) that converts light projected from the projection device into electric power, and the like.

<Configuration of projector>
FIG. 3 shows a control block diagram of an example of the projector according to the embodiment of the invention. In the following, when it is not necessary to distinguish between the projection apparatuses 20-1 to 20-6 shown in FIGS. 1 and 2, the projection apparatus 20 will be described as a generic term.

  As shown in FIG. 3, the projector (projection apparatus) 20 includes a DLP controller 211, a ROM 212, a RAM 213, a communication unit 220, a video projection unit 230, an input unit 240, an audio output unit 250, an operation unit 260, and the like.

  The video projection unit 230 includes a light emitting device 231, a color wheel 233, a DMD (Digital Micromirror Device) 235, and the like. Details of the video projection unit 230 will be described later with reference to FIG.

  The communication unit 220 includes a LAN controller 221. The LAN controller 221 functions as an image input unit, an instruction position input unit, and a coordinate position output unit. The image input unit receives projection image data from the control terminal 10. The designated position input unit receives position information transmitted from the electronic pen 30. The coordinate position output unit transmits the position information located from the electronic pen 30 to the control terminal 10 as a coordinate position.

  The input unit 240 has input interfaces such as AFE (Analog Front End) 241, HDMI (registered trademark) 242, and USB 243. Note that the terminals of these input units 240 are used for inputting projection image data at the time of wired connection, and the LAN controller 221 is used when an image is transmitted wirelessly as shown in FIG. When the control terminal 10 and the projection device 20 are connected by wire, the input unit 240 also functions as a communication unit that outputs projection image data.

  The operation unit 260 includes an operation panel 261 provided on the main body of the projection device 20-1, a remote control 262 that can be remotely operated, and a remote control light receiving unit 263 provided on the main body side that receives an input from the remote control 262. . The operation unit 260 notifies the DLP controller 211 of various operation inputs from the user.

  The DLP controller 211 controls light emission control for the light emitting device 231, rotation control for the color wheel 233, display control of image data for the DMD 235, audio output control for the audio output unit 250, and the like.

  Specifically, the DLP controller (control unit) 211 performs various image processing such as gradation processing, scaling, and keystone correction on the image data input from the control terminal 10 via the communication unit 220 or the input unit 240, and performs image processing. Image data for later projection is created. Then, the created image data is displayed on the DMD 235.

  In addition, the DLP controller 211 sends a projection audio signal included in the received image data to the audio output unit 250 and causes the audio output unit 250 to output the audio.

  The DLP controller 211 controls the brightness of the light emitting device 231 based on the image data. In the DLP controller 211, a control signal to the light emitting device 231 and a control signal to the DMD 235 are connected, and the projected image and brightness are controlled in conjunction with each other.

  Then, when the DLP controller 215 rotates the color wheel 233, the color wheel 233 separates the light source light from the light emitting device 231 into RGB colors in a time-sharing manner, and RGB single color lights are incident on the entire display area of the DMD 235. Let

  Specifically, since the index is marked on the color wheel 233, the sensor 238 can detect the index. The DLP controller 215 feeds back the index detection result detected by the sensor 238 to a motor (drive unit) 236 that drives the color wheel 233 to control rotation.

  In general, the color wheel 233 is rotationally controlled to a rotational speed of 100 Hz to 120 Hz, but the DLP controller 211 sets the rotational target value when synchronizing with other projection apparatuses 20-2 to 20-6. By setting to another value, the rotational frequency can be dynamically controlled. The DLP controller 211 also functions as a timing control unit. Since the index is detected by the sensor 238 and fed back to the motor control, the color wheel can be stably rotated even if the rotation speed changes.

  A pattern image (a main position detection pattern, a sub position detection pattern) is also embedded in the color wheel 233 in order to detect the designated position with the electronic pen 30. Details of the pattern image will be described later with reference to FIG.

  FIG. 4 is an explanatory diagram showing an optical path in the image projection unit 230 of the projector according to the embodiment of the invention. FIG. 4 shows an example of the projection of the partial projection image by the light emitting device 231, the color wheel 233, and the DMD 235 of the present embodiment.

  The light emitting device 231 includes a lamp, a ballast, an LED light source, and the like.

  Light from the light emitting device 231 enters the color wheel 233 via the lens 232. The light time-divided into RGB colors by the color wheel 233 is incident on the DMD 235 that displays the partial projection image via the lens 234. The light reflected by the DMD 235 is projected onto the projection medium via the projection lens 237. Thereby, the partial projection image is projected onto the projection medium.

  The DMD 235 is a one-chip DLP semiconductor, and 480,000 to 2 million ultra-small mirrors (micro mirrors) that move independently are spread on the surface of the semiconductor.

  As shown in FIG. 4, the light from the light source passes through a color wheel 233 that is color-coded into three colors of RGB, and then reaches a DMD 235 on which micromirrors are spread. After the light is reflected by the DMD 235, the light is projected through the projection lens 237.

  The light projected from the projection lens 237 is actually one color that can be projected at a time, but the color wheel rotates at a high speed, and the DMD235 micromirror also responds at a high speed of several thousand times per second. Since the on / off is switched, the image projected on the projection medium appears to human eyes as light in which RGB colors are combined, that is, as a color image.

  FIG. 5 is a block diagram showing an example of the color wheel filter of FIG. As shown in FIG. 5, the color wheel 233 is assigned filters of a plurality of colors, for example, R (red), G (green), B (blue), and white (W).

  Specifically, in the color wheel 233, in order to separate the white light from the light emitting device 231, fan-type color separation filters of RGB colors are sequentially arranged on a disk. The color wheel 233 is also provided with a white fan-shaped color separation filter on the disk for brightness adjustment. The color wheel 233 may be provided with a region that does not pass a filter for adjusting the brightness of the projected image.

  By rotating the color wheel 233 having such a configuration, the incident light source light is color-separated into R, G, and B in a time-sharing manner, and each monochromatic light is sequentially incident on the entire display area of the DMD 235. Can do.

  Further, in position detection described later, ON / OFF in the light emitting device 231 is adjusted for detection of the sub position detection pattern with the electronic pen 30. Details will be described later with reference to FIGS.

  FIG. 6 is a diagram illustrating the configuration of the electronic pen 30. Note that the configuration of FIG. 6 is an example, and other configurations may be used.

  As shown in FIG. 6, the electronic pen 30 is provided with a switch 31 at the tip of the pen and a camera 32 is incorporated. When the user presses the pen tip against the screen, the pen tip switch 31 is turned on. While the pen tip switch 31 is ON, the camera 32 built in the electronic pen 30 detects a plurality of position detection patterns, which are position identification information, projected on the screen 40, and narrows down and specifies the position of the pen tip.

  When the projectors 20-1 to 20-6 recognize the electronic pen 3- at the time of setting up the interactive configuration, the projection timing of the position detection pattern is synchronized with the camera image capturing timing of the electronic pen 30.

<Embedding pattern image>
FIG. 7 is an explanatory diagram of an example of pattern image projection timing. In FIG. 7, the time series of the light emitted from the color wheel 233 is shown, and it is assumed that W, R, G, and B are in order of the time series.

  In the example of FIG. 7, it is assumed that one or more main position detection pattern images for identifying positions are embedded in the white (W) filter of the color wheel 233. This is because the white area of the color wheel is mainly used to improve the overall luminance, and if the position detection pattern is embedded in the white area, it is detected with little influence on the color. It may be embedded in other color areas.

  For example, assume that the position detection pattern is projected twice at the timings t1 and t2 of the white region. Therefore, one or more pattern images are superimposed on the partial projection image and projected onto the projection medium at the timing of t1 or t2 in the example shown in FIG. 7, and the electronic pen 30 detects these pattern images. By doing so, the indicated position of the electronic pen 30 is specified.

  FIG. 8 is an explanatory diagram of an example of a method for detecting the writing position embedded in the white pattern. The writing position of the electronic pen 30 is specified by this detection method. FIG. 8 shows an example in which the pattern images P1 and P2 are embedded in the white filter of the color wheel 233.

  The pattern image P1 is assumed to be a first main position detection pattern image projected at the timing t1 in the example shown in FIG. The pattern image P2 is assumed to be a second main position detection pattern image projected at the timing t2.

  In FIG. 8, the main position detection pattern image P1 is a position identification image in which four types of patterns (marks) M1 to M4 are assigned in four regions, and the main position detection pattern image P2 is a set of four types of marks M1 to M4. Is an example of a position identification image assigned to 16 divided areas. Note that the pattern image is an example, and as the number of mark types (M) is increased, the number of areas that can be detected is subdivided and can be detected (in an M × M area).

  For example, the electronic pen 30 has a mark M3 in the first main position detection pattern image P1 at the timing t1 in the example shown in FIG. 7 by pressing the pen tip against the projection medium on which the partial projection image is projected. And the mark M2 in the second main position detection pattern image P2 is detected at the timing t2.

  In this case, as shown in FIG. 8, since the electronic pen 30 detects the mark M3 in the first main position detection pattern image P1 and the mark M2 in the second main position detection pattern image P2, the partial projection image is displayed. When divided into 16 areas a to p, the area j can be specified as the writing position.

  Although the example of the main position detection pattern embedded in the white area has been described with reference to FIG. 8, the same marks (M1 to M4) as those in FIG. 8 are also combined for the sub position detection pattern embedded in the green area illustrated in FIG. The position can be detected by detecting a specific pattern (mark) from the pattern image.

  In the examples of FIGS. 7 and 8, the specification of the writing position by the electronic pen on the projection medium projected from one projection apparatus has been described, but this identification method can also be applied to a system of a plurality of projection apparatuses.

<Comparative example>
FIG. 9 is a diagram for explaining an interactive function configuration that can be realized by the multi-projection system of the comparative example.

  In the configuration of the comparative example, a plurality of screens 40-1X, 40 from a plurality of projection devices 20-1X, 20-2X, 20-3X connected to a plurality of control terminals 10-1X, 10-2X, 10-3X, respectively. -Project on 2X and 40-3X screens (multiscreen, large screen). In this system, a plurality of electronic pens and control terminals are required, and a plurality of interactive configurations of the electronic pen, the projection device, the control terminal, and the screen are forcibly arranged.

  FIG. 10 is a diagram for explaining the rotation timing of the color wheel in a plurality of projectors in the comparative example of FIG.

  In the example of FIG. 10, since there are a plurality of control terminals that control the plurality of projection apparatuses 20-1X to 20-3X as shown in FIG. 9, the color wheel between the respective projection apparatuses 20-1X to 20-3X is a device. Are different depending on the startup timing, etc., and are not synchronized.

  In this state, when the writing detection control as shown in FIGS. 7 and 8 is applied to the system shown in FIG. 9 as it is, the writing position information recognized by the electronic pen 30 is stored in all the projection devices 20-1. The problem of being transmitted to 20-6 occurs.

  Therefore, in the embodiment of the present invention, each projection device and the control terminal are connected by a network, and the color wheel is synchronized between interactive (write position detection) patterns for a plurality of projection devices. The electronic pen 30 and the control terminal can be integrated.

<Setting of the multi-projection system of the present invention>
Here, setting with a plurality of projection apparatuses, one control terminal, and one electronic pen will be described. FIG. 11 is a perspective view for explaining a setting method of the multi-projection system according to the embodiment of the present invention.

  The electronic pen 30 detects an indication position that is a position (writing position) pointed to by the pen tip with respect to the projection images projected by the projection apparatuses 20-1 to 20-6, and sends them to the projection apparatuses 20-1 to 20-6. Instruction position information (writing position information) indicating the detected instruction position is transmitted.

  When receiving the writing position information, the projection devices 20-1 to 20-6 transmit coordinate data (coordinates in the image data) specified by the received writing position information to the control terminal 10. Thereby, the control terminal 10 can grasp the position indicated by the electronic pen 30 with respect to the projection image.

  In order to realize such an interactive function in the multi-projection system 1, first, as a preliminary work, setup such as installing and executing the interactive software 12 shown in FIG. 1).

  In use, the projector adapter 21 is set in the plurality of projection apparatuses (projectors) 20-1, and the projection apparatuses 20-1 to 20-3 are set to the interactive mode, that is, the interactive function is turned on ( 2). At this time, each projection device 20-1 sets an ID (see FIG. 18) that defines the priority of each projection device when the interactive function is turned on.

  Here, the ID that defines the priority is a portion that is arbitrarily provided according to the installation position, and is an overlapping portion of images projected from two or more projection devices. This is priority information. The lower the ID number, the higher the priority.

  Next, the PC USB adapter 11 is set in the control terminal 10. Then, the projector 20 is made to recognize the electronic pen 30 (perform configuration) (4). At this time, the electronic pen 30 is preset with position information to be transmitted to a specific projection device, and different channels for wireless communication are set for each projection device, and the electronic pen 30 recognizes each projection device 20-1 to 20-6. At the time of work (pairing), IDs that define the priorities of the projection apparatuses 20-1 to 20-6 are read.

  Specifically, a combination of first and second main position detection patterns and sub position detection patterns including a specific mark for position detection, a region on the partial projection image, and a projection device 20 that projects the partial projection image The correspondence with -1 to 20-6 is read and set when the interactive function is set up.

  For this reason, the electronic pen 30 projects a region on the partial projection image and the partial projection image from the combination of the detected mark in the main position detection pattern P1 and the mark in the main position detection pattern P2 (self-projection). Device) 20 can be identified.

  The projection timing of the main position detection pattern image and the sub position detection pattern image and the detection timing by the camera 32 are also read at the time of setting up the interactive function and set so as to be synchronized.

  Then, the electronic pen 30 transmits writing position information (instruction information) indicating the specified writing position to the specified self-projection device 20X. At this time, the electronic pen 30 changes the channel used for wireless transmission according to the self-projection device 20 of the transmission destination. Thereby, it is possible to prevent the projection apparatus 20 other than the transmission target from receiving the designated position information.

  Then, the communication unit 220 of the projection apparatus 20 that has received the designated position information wirelessly transmits an ID for identifying the projection apparatus 20 to the control terminal 10 together with the received designated position information.

  By setting in this way, when the projector is made to recognize the electronic pen 30 (pairing), the device setup is performed in consideration of the ID indicating the arrangement order of the projectors. Position information can be exchanged between the projection apparatuses 20-1 to 20-6 and the control terminal 10 through wireless communication.

  Thus, for example, when the electronic pen 30 is held over the screen area 40-1 of the projection device 20-1, and the pen tip switch 31 is turned on, the position information is transmitted from the electronic pen 30 to the projection device 20-1. . Similarly, in the case of the screen region 40-2 of the projection device 20-2, the projection device 20-2 is transferred from the electronic pen 30 to the projection device 20-2. In the case of the screen region 40-3 of the projection device 20-3, the projection device 20-3 is transferred from the electronic pen 30. The position information is transmitted to.

  In addition, in FIG. 11, although demonstrated using the three projection apparatuses 20-1 to 20-3, the same setting is implemented also about the projection apparatuses 20-4 to 20-6.

  FIG. 12 is a control flowchart for controlling the number of rotations of the color wheel in a plurality of projectors according to the present invention. FIG. 13 is a diagram for explaining the synchronous control of the rotation timing of the color wheel between a plurality of projectors in the present invention.

  12 and 13, first, the DLP controller 211 of each projector 20 reads the index detection timing from the color wheel 233 of the projector 20 detected by the sensor 238 (step S1).

  Subsequently, the reference projector (for example, ID-1 20-1) which is one of the projectors 20 is different from the reference projector 20-1 in the projectors 20-2 to 20- whose index detection timing is shifted. 6 is caused to advance the rotation cycle of the color wheel 233 (step S2).

  Subsequently, the DLP controller 211 of each projector 20-1 to 20-6 reads the detection timing of the index of the color wheel 233 detected by the sensor 238 for the projector 20 (step S3).

  If the index detection timings coincide with each projector 20 (YES in step S4), the DLP controller 215 of the projector 20 that has advanced the rotation cycle of the color wheel 233 returns the rotation cycle of the color wheel 233 to the original (step). S5).

  On the other hand, if the index detection timing does not match in each projector 20 (No in step S4), the process returns to step S3.

  The processing shown in FIG. 13 allows synchronization even if the rotation of the color wheel 233 is shifted between the projectors 20-1X to 20-3X as shown in FIG.

  The control terminal controls the color hole rotation speed of each projection apparatus according to the flowchart described below. Thereby, in the example of FIG. 13, it is possible to synchronize the rotation of the color wheel of each projection apparatus in the seventh period.

<Overlapping part>
FIG. 14 shows an example of a schematic configuration when screens are provided to overlap each other in the multi-projection system according to the present invention.

  In the multi-projection system, projection objects are displayed with overlapping portions of projection images on a combination of a plurality of screens (multi-screen) or a large projection surface (projection mapping onto a building, etc.).

  The control terminal generates an image of each projection apparatus that takes into account the blending of overlapping portions using an application dedicated to multi-projection projection.

  Each projection apparatus displays this, thereby realizing multi-projection projection as the entire system.

  FIG. 15 is an explanatory diagram of the overlapping of a plurality of screens of the image displayed in FIG. As shown in FIG. 14, images projected from a plurality of projection devices are overlapped at a screen connection location.

  In FIG. 15, an overlapping portion Oa of edges is a precoding processing unit that is projected by two projection devices 20-4 and 20-5 adjacent in the horizontal direction. When the electronic pen 30 uses the two main position detection patterns to detect the overlapping portion Oa as the writing unit, since the main position detection pattern is common among the plurality of projection apparatuses, the position information is projected to the projection apparatuses 20-4 and 20-. It is impossible to determine to which of 5 should be transmitted.

  Similarly, the overlapping portion Ob of the edge is, for example, a preprocessing unit that is projected by two projectors 20-2 and 20-5 adjacent in the vertical direction by stacking the projectors or projecting from above and below. is there. When the electronic pen 30 uses the two main position detection patterns to detect the overlapping portion Ob as the writing unit, the main position detection pattern is common among the plurality of projection apparatuses, and thus the position information is transmitted to the projection apparatus 20-2 and the projection apparatus 20-. It is impossible to determine to which of 5 should be transmitted.

  Further, the overlapping portion Oc of the edge in FIG. 15 is a precoding processing unit projected by the four projection devices 20-1, 20-2, 20-4, and 20-5 adjacent in the vertical and horizontal directions. When the electronic pen 30 uses the two main position detection patterns to detect the overlapping portion Oc as the writing unit, the main position detection pattern is common among the plurality of projection apparatuses, and thus the position information is projected to the projection apparatuses 20-1 and 20-2. It cannot be determined which of 20-3 and 20-4 should be transmitted.

  In order to solve this situation, in addition to the main position detection pattern, the projection apparatus according to the embodiment of the present invention sets the sub position detection pattern having priority for each projection apparatus in a place different from the main position detection pattern. Embed. For example, the sub position detection pattern may be a position that is different from a portion where the main position detection pattern is embedded, and may be a position that is different among a plurality of projection apparatuses. For example, the sub position detection pattern may be embedded in the same area (color) as the main position pattern area in the color wheel, or an area (for example, a white area) different from the area in which the main position detection pattern is embedded (for example, a white area). It may be embedded in any region of RGB.

<Projection plane position control>
FIG. 16 shows an example of a control flowchart in position information detection of the present invention. FIG. 17 shows an example in which the position detection pattern on the color wheel of each projector of the present invention is embedded in the green region.

  In the example of FIG. 17, the projection apparatus 20-1 has a period different from the main position detection pattern detected at timing 45 ms (t 1, t 2) as the position detection pattern as position identification information, and the timing for ID 1 is 47 ms. The sub position detection pattern detected at (t11, t12) is embedded.

  Similarly, in the projection device 20-2, as the position identification information, a main position detection pattern detected at timings t1 and t2 and a sub position detection pattern detected at timing 49ms (t21, t22) for ID2 are embedded. Yes. In the projection apparatus 20-3, as position identification information, a main position detection pattern detected at timings t1 and t2 and a sub position detection pattern detected at timing 52ms (t31, t32) for ID3 are embedded.

  Similarly, the projectors 20-4, 20-5, and 20-6 have main position detection patterns detected at timings t1 and t2, and sub-position detection patterns detected at timings 55ms, 58ms, and 61ms according to IDs. Embed.

  Referring to FIGS. 16 and 17, in electronic pen 30, position detection information is extracted from an image captured by camera 32 (step S11) (imaging step, position identification information detection step).

  Next, it is detected whether the detected position identification information is only one set of main position detection pattern and sub position detection pattern (step S12).

  In the case of one set (YES in step S12), the position information specified based on the detected main position detection pattern is transmitted to the own projection device that projects the position information (step S13).

  If NO in step S12, it is assumed that there are two or more sub-position detection patterns, and the priority of information detection of the sub-position detection pattern is confirmed and compared (step S14).

  Here, the main position detection pattern when the electronic pen 30 detects a plurality of sub position detection patterns is a combination of the main position detection patterns of adjacent projectors that project adjacent screens. And In this flow, S12 to S14 are position specifying steps for specifying the writing position of the electronic pen.

  Then, the self-projection device that projects the partial image including the writing position, identified based on the sub-position detection pattern set as the highest priority among the priorities of the detected sub-position detection patterns The position information is transmitted to (S15).

  Note that the pattern embedded in green is the same as the pattern shown in FIG.

  The electronic pen detects the main position detection pattern and the sub position detection pattern including the mark as shown in FIG. 8 together, and as shown in FIG. A projection device).

  As described above, when the electronic pen 30 detects the detected sub position detection pattern (position detection pattern with priority), the projection image overlaps by having priority order information between the projection apparatuses when specifying the projection apparatus. It is possible to transmit position information to a specific projection apparatus (self-projection apparatus) even in a certain area.

  Here, in the detection, the sub-position detection patterns that are different for each of the plurality of projection devices are not identified at the time of sale, for example, and include a plurality of sub-position detection patterns for one projection device in advance. To do.

  When used in a multi-projection system, the light emitting device 231 is turned on at the timing of the associated ID sub-position detection pattern, and the light emitting device 231 is turned off at other sub-position timings. To do.

  For example, in the projection device 20-1, the light emitting device 231 is turned on at the main position timings t1, t2 and the sub position timings t11, t12, and the light emitting device 231 is turned on at the sub position timings (t21, t22), (t31, t32), and the like. Turn off.

  As a result, when the writing portion photographed with the electronic pen 30 is a partial projection image projected from the projection device 20-1, the sub position detection pattern is detected at the sub position timings t11 and t12. Position detection at timings (t21, t22), (t31, t32)... Is not performed.

  Similarly, the projection device 20-2 to the projection device 20-6 perform ON / OFF control of the light emitting device 231. In one projection device, position detection is performed only at one ID sub-position timing. . However, when position detection is performed at each ID sub-position timing in a plurality of projection apparatuses, the priority described later is referred to, and the projection apparatus with the highest priority receives data (position information) from the electronic pen 30. ).

  As shown in FIG. 17, the sub position detection pattern may be embedded in the same area as the area where the main position detection pattern is embedded in the color wheel, or the area where the main position detection pattern is embedded (for example, a white area). ) May be embedded in a different area (for example, any area of RGB).

  18A shows an example of data stored for position detection by a plurality of projectors, and FIG. 18B shows an example of priority data embedded in the electronic pen. Here, the priority information is the data in which the priority for each ID is associated with the projector to be arranged.

  For example, when priorities are set in advance as ID1> ID2> ID3> ID4> ID5> ID6, the projection device 20-1 has priority over the sub-position detection pattern at the connection point between the projection device 20-1 and the projection device 20-2. Accordingly, the electronic pen 30 transmits the position information only to the projection device 20-1.

  Thus, in order to control the interaction between the entire display image and the PC (control device) with one electronic pen 30, the color wheel between the projection devices is synchronized, and the electronic pen 30 has priority over the main position detection pattern. Two types of position identification information of sub-position detection patterns having degrees are detected.

  The control shown in FIGS. 16 to 18 will be examined with reference to FIGS.

  In FIG. 15, the edge overlapping portion Oa described above is a precoding processing unit that is projected by two projection devices 20-4 and 20-5 adjacent in the horizontal direction. Since the priority of FIG. 18A is ID4> ID5, when the electronic pen 30 detects the overlapping portion Oa by the two sub-position detection patterns as the writing portion, the detected position information is the projection device 20- 4 is determined to be transmitted.

  Further, the overlapping portion Ob of the edge in FIG. 15 is a precoding processing unit that is projected by two projection devices 20-2 and 20-5 adjacent in the vertical direction. Since the priority in FIG. 18A is ID2> ID5, when the electronic pen 30 serves as a writing unit and detects the overlapping portion Ob using two sub-position detection patterns, the detected position information is the projection device 20- 2 is determined to be transmitted.

  Further, the overlapping portion Oc of the edge in FIG. 15 is a precoding processing unit projected by the four projection devices 20-1, 20-2, 20-4, and 20-5 adjacent in the vertical and horizontal directions. Since the priority in FIG. 18A is ID1> ID2> ID4> ID5, when the electronic pen 30 detects the overlapping portion Oc by the four sub-position detection patterns as the writing portion, the detected position information is It is determined to transmit to the projection device 20-1.

  Thus, in order to control the interaction between the entire display image and the PC (control device) with one electronic pen 30, the color wheel between the projection devices is synchronized, and the electronic pen 30 has priority over the main position detection pattern. It is possible to detect two types of position identification information of the sub-position detection pattern having a degree. In other words, it is possible to correctly identify the writing position information of the electronic pen in a region where projection images projected from a plurality of projection devices overlap.

  In the above-described embodiment, an example in which six projection apparatuses are provided in the multi-projection system has been described, but the number is not limited as long as the number of projection apparatuses to be used is two or more.

  Although the projection apparatus, the multi-projection system, and the position specifying method of the multi-projection system according to the embodiments have been described above, the present invention is not limited to the above-described embodiments, and various modifications and improvements are within the scope of the present invention. Is possible.

1 Multi-projection system 20-1, 20-2, 20-2, 20-3, 20-4, 20-5, 20-6 Projection device (projector, display device)
220 Communication unit 235 Color wheel 30 Electronic pen 31 Imaging unit 310 Data processing unit (position specifying unit)
320 Communication unit (transmission unit)
40 screens (multi-screen, projection surface)
t1, t2 Main position detection pattern detection timing t11, t12 ID1 sub-position detection pattern (priority detection pattern) detection timing t21, t22 ID2 sub-position detection pattern (priority detection pattern) detection timing t31, t32 Detection timing of ID3 sub-position detection pattern (priority detection pattern) M1, M2, M3, M4 Marks a to p Position detection areas P1, P2 Pattern image

JP 2007-48135 A JP 2006-349791 A

Claims (8)

A plurality of projection devices for projecting an image, an electronic pen capable of writing on the projected image, output projection image data to the projection device, and writing on the projected image by the electronic pen to the projection image A projection apparatus applicable to a multi-projection system having an information processing terminal that can be reflected in data,
The projector is
A communication unit that is connected to each of the information processing terminal, the electronic pen, and each of the plurality of projection apparatuses via a network, and that outputs a writing position transmitted from the electronic pen to the information processing terminal;
A light emitting means for projecting light; and a plurality of areas so as to time-divide the projected light into a plurality of colors by rotation; Priority including information on priority between the projection devices when the projection device is specified, the position on the partial image is specified, and the images projected from two or more projection devices overlap each other. An embedded color wheel so that a position detection pattern with a degree is set at different positions among the plurality of projection devices;
Projection device. The color wheel specifies a self-projection device that projects a partial image including the writing part as the position identification information, and specifies a position on the partial image. It is further embedded at a position different from the position detection pattern with priority at the same position between devices,
The projection apparatus according to claim 1. A plurality of projection devices for projecting images;
An electronic pen that can write to the projected image;
A multi-projection system comprising: an information processing terminal that outputs projection image data to the projection device and can reflect the writing by the electronic pen on the projected image in the projection image data;
Each projection device of the plurality of projection devices includes a partial image constituting a part of the whole projection image so that the projection images projected from the plurality of projection devices are gathered to form one whole projection image as a whole. Project,
Each of the projection devices
A communication unit that is connected to each of the information processing terminal, the electronic pen, and each of the plurality of projection apparatuses via a network, and that outputs a writing position transmitted from the electronic pen to the information processing terminal;
A light emitting means for projecting light; and a plurality of areas so as to time-divide the projected light into a plurality of colors by rotation; Priority including information on priority between the projection devices when the projection device is specified, the position on the partial image is specified, and the images projected from two or more projection devices overlap each other. An embedded color wheel, so that a position detection pattern with a degree is set at different positions between the plurality of projection devices,
The electronic pen is
A photographing unit for photographing a writing portion in the projected image;
A position identifying unit that extracts the position identification information from the photographed writing portion, identifies the writing position based on the position identification information, and a transmission unit that transmits the writing position to the projection device. ing,
Multi-projection system. The color wheel specifies a self-projection device that projects a partial image including the writing part as the position identification information, and specifies a position on the partial image. It is further embedded at a position different from the position detection pattern with priority at the same position between devices,
When the position specifying unit detects one main position detection pattern and a position detection pattern with priority, the position specifying unit specifies a self-projection device that projects a partial image including the writing position based on the main position detection pattern. And
When detecting a plurality of prioritized position detection patterns, the writing portion is detected as being included in a portion where images projected from two or more projection devices of the plurality of projection devices overlap. The write position is included based on the priority position detection pattern that is set to have the highest priority among the detected priority detection patterns of the plurality of priorities by disabling the main position detection pattern. Identify the self-projection device that projected the partial image
The multi-projection system according to claim 3. Each projection device of the plurality of projection devices is
When the writing is started by the driving unit that rotationally drives the color wheel, and the electronic pen, the rotation period of the color wheel by the driving unit is controlled every predetermined period, and the plurality of projection apparatuses A timing control unit that synchronizes the rotation of the color wheel every predetermined period;
The position specifying unit of the electronic pen specifies a self-projection apparatus that projects a partial image including the writing part by identifying detection timing of the position detection pattern with priority.
The multi-projection system according to claim 4. In the plurality of light emitting units of the plurality of projection devices, the plurality of light emitting units of one projection device are turned off at the timing when the light emitting unit of one projection device projects onto the plurality of position detection patterns with priority. The priority position detection patterns are set at different positions in the color wheels of the projection apparatuses, and the priority position detection patterns are detected at different timings in the plurality of projection apparatuses.
The multi-projection system according to claim 5. A method for specifying a position of a multi-projection system, comprising: a plurality of projection devices that project an image; an electronic pen that can write to the projected image; and an information processing terminal that outputs projection image data to the projection device. ,
In each of the plurality of projection apparatuses, the self-projection apparatus that projects the partial image including the writing part as position identification information is specified, and the position on the partial image is specified. In a portion where the projected images overlap, a position detection pattern with priority including priority information between the projection apparatuses when specifying the own projection apparatus is set at different positions among the plurality of projection apparatuses. Projecting partial images constituting a part of the whole projection image through the embedded color wheel so that the projection images projected from the plurality of projection devices are gathered into one whole projection image. And steps to
A photographing step of photographing a writing portion in the projected image with the electronic pen;
A position specifying step of extracting the position identification information from the written portion photographed with the electronic pen, and specifying the writing position based on the position identification information;
Transmitting the writing position identified by the electronic pen to a self-projecting device including the writing position;
Reflecting the writing by the electronic pen on the projected image in the projection image data via the self-projection device in the information processing terminal.
A method for locating a multi-projection system. In the position specifying step, when a plurality of prioritized position detection patterns are detected, the writing portion is included in a portion where images projected from two or more projection devices of the plurality of projection devices overlap. A partial image including the writing position is projected on the basis of the priority position detection pattern that is set to have the highest priority among the detected priority detection positions. Identify the autoprojector,
The position specifying method of the multi-projection system according to claim 7.