JP2012216928A - Projection system, projection device, projection method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To directly execute three-dimensional position designation and image drawing corresponding to a three-dimensional image for projection.SOLUTION: A projection system includes: an input unit 11 for inputting an image signal; a projection system (13-18) for projecting a left-eye image and a right-eye image, each having invisible position coordinate information superposed thereon, corresponding to the image signal input by the input unit 11; an antenna 26 and a pointer communication unit 24 for receiving information indicative of each position coordinate of the left-eye image and the right-eye image sent from a point device (2) and information indicative of the direction and the magnitude of external force given to the pointer device (2); and a CPU 19 for calculating, based on the received information, the designation position of the image, projected by the projection system (13-18), in a three-dimensional space, and for projecting an image obtained by adding a predetermined point image to the image projected by the projection system (13-18) according to the calculated designation position in the three-dimensional space.

Description

  The present invention relates to a projection system, a projection apparatus, a projection method, and a program for projecting a stereoscopic image.

  Recently, projection and display of stereoscopic images have been put into practical use in movies, liquid crystal televisions, and portable games, and they are going to spread widely. When it is intended to realize this type of stereoscopic image projection function with a projector device, for example, a stereoscopic system using liquid crystal shutter-type dedicated glasses is similar in principle to a liquid crystal television and the like. It can be realized.

  However, unlike a liquid crystal television or the like, a projector device may need to indicate an arbitrary position in a projected image using a tool such as a laser pointer. Since it indicates (points to) a two-dimensional position in the middle, for example, the relationship in the depth direction with the projected stereoscopic image cannot be expressed.

  In the field of computers using a GUI (graphical user interface), an item displayed in a pseudo three-dimensional manner is operated using a device that inputs pseudo three-dimensional information such as a pressure-sensitive tablet. Technology to do is considered. (For example, Patent Document 1)

JP-A-11-007372

  The above-mentioned patent document is a technology that is considered as a pointer for designating a position by an indirect operation of a tablet or the like with a computer using a GUI, and cannot directly designate an arbitrary position in a displayed image. Therefore, it cannot be applied to a technique that directly indicates a position in a stereoscopic image to be projected by a projection apparatus such as a projector apparatus.

  The present invention has been made in view of the above circumstances, and the object of the present invention is a projection system capable of directly executing three-dimensional pointing and drawing corresponding to a three-dimensional image to be projected, To provide a projection device, a projection method, and a program.

  One aspect of the present invention is a projection system that includes a projection device and a point device that designates an arbitrary position in an image projected by the projection device, and the point device is a left-eye image projected by the projection device. And position acquisition means for reading and demodulating information indicating each position coordinate superimposed on each image when the point operation is performed toward the right-eye image, and the direction and magnitude of the external force applied to the apparatus during the point operation. A transmission for transmitting to the projection apparatus information indicating the position coordinates obtained by the position acquisition means and information indicating the direction and magnitude of the external force detected by the operation detection means. The projection device includes: an input unit that inputs an image signal; and an image for the left eye that corresponds to the image signal input by the input unit and in which invisible position coordinate information is superimposed on each of the image signal Projecting means for projecting the eye image, information indicating the position coordinates of the image for the left eye and the image for the right eye, and information indicating the direction and magnitude of the external force sent from the transmitting means of the point device. A receiving means for receiving, a position calculating means for calculating a designated position in a three-dimensional space of an image projected by the projecting means based on information received by the receiving means, and a three-dimensional value calculated by the position calculating means. Projection control means for adding a predetermined point image to an image projected by the projection means according to a specified position in space and projecting the image.

  According to the present invention, it is possible to directly execute three-dimensional pointing, drawing, or the like corresponding to a three-dimensional image to be projected.

The figure which shows schematic structure of the projection system which concerns on one Embodiment of this invention. FIG. 3 is a block diagram showing a functional configuration inside the data projector apparatus according to the embodiment. The block diagram which shows the function structure inside the point pen which concerns on the same embodiment. 9 is a flowchart showing the contents of a drawing process mainly accompanying a point pen operation that is executed during a projection operation in the data projector apparatus according to the embodiment.

Hereinafter, an embodiment in which the present invention is applied to a 3D projection system including a DLP (registered trademark) type data projector apparatus will be described with reference to the drawings.
FIG. 1 shows a schematic configuration of the 3D projection system. In FIG. 1, reference numeral 1 denotes a data projector device, and 2 denotes a point pen dedicated to the data projector device 1. The data projector device 1 and the point pen 2 are wirelessly connected by, for example, Bluetooth (registered trademark) technology. The data projector apparatus 1 projects an image corresponding to an image signal input from an externally connected device or an image file recorded in a USB memory or the like onto a screen SC to be projected.

  The image projected by the data projector apparatus 1 is invisible to the naked eye, but the position coordinate information is superimposed on the original image by PWM modulation on the gradation expression for each pixel area.

  In addition, the image projected by the data projector apparatus 1 is alternately output as a left-eye image and a right-eye image by time division. The user who views the image projected on the screen SC wears the 3D glasses 3, and the left eye and the right eye are shielded by the liquid crystal shutter formed alternately on the lens surface in synchronization with the projected image. And the right-eye image are correctly recognized and can be recognized as a 3D (stereoscopic) image.

  As will be described in detail later, the point pen 2 includes a light receiving system and a demodulating circuit for the position coordinate signal, and demodulates the position coordinate signal at the point position by setting an arbitrary position in the projected image as a point. Then, the information indicating the external force when the point pen 2 is operated at that time is transmitted to the projector 1.

  Receiving this, the data projector device 1 projects the pointer image PT on the corresponding position in the projection image, for example, as shown in the figure.

Next, the schematic functional configuration of the data projector apparatus 1 will be described with reference to FIG.
In the figure, reference numeral 11 denotes an input unit which includes, for example, a video input terminal, an RGB input terminal, a VGA terminal and the like. The image is sent to the image conversion unit 13 via SB1.

  Reference numeral 12 denotes a USB (Universal Serial Bus) interface (I / F), which includes a Universal Serial Bus terminal. When, for example, a personal computer is connected as an external device using a USB cable (not shown), digital data such as a still image, a moving image, and sound can be input to the data projector apparatus 1 by USB isochronous transfer.

  However, the image conversion unit 13, also called a scaler, converts the image signal input via the input unit 11 or the USB interface 12 into image data of a predetermined format suitable for projection, and sends the image data to the projection processing unit 14.

  At this time, the image conversion unit 13 also superimposes the image data such as symbols indicating various operation states for OSD (On Screen Display) and the above-described image data such as the pointer image PT on the image data as necessary, and converts the processed image data into the image data. The image is sent to the projection processing unit 14.

  The projection processing unit 14 has a display memory (video memory) inside, and according to the transmitted image data, a frame rate according to a predetermined format, for example, 120 [frames / second] (left-eye image). And the right-eye image are multiplied by 60 [frames / second]), the number of divisions of the color component, and the number of display gradations, and the data stored in the display memory is spatially generated by faster time-division driving. The micromirror element 15 which is a light modulation element is driven to display.

  The micromirror element 15 is individually turned on / off at a high speed for each inclination angle of a plurality of micromirrors arranged in an array, for example, WXGA (Wide eXtended Graphics Array) (1280 pixels × 800 pixels). By displaying the image, an optical image is formed by the reflected light.

  At this time, the image displayed by the micromirror element 15 is invisible to the naked eye, but the position coordinate information for each pixel region is superimposed on the original image by PWM modulation on the gradation expression.

  On the other hand, light of a plurality of colors including primary color lights of R, G, and B is sequentially emitted in a time division manner from the light source unit 16 in a time division manner. The light from the light source unit 16 is totally reflected by the mirror 17 and applied to the micromirror element 15.

  Then, a light image corresponding to the color of the light source light is formed by the reflected light from the micromirror element 15, and the formed light image is projected and displayed on a screen (not shown) to be projected via the projection lens unit 18. .

  The CPU 19 controls all the operations of the above circuits. The CPU 19 is directly connected to the main memory 20 and the program memory 21. The main memory 20 is composed of, for example, an SRAM and functions as a work memory for the CPU 19. The program memory 21 is composed of an electrically rewritable nonvolatile memory, and stores an operation program executed by the CPU 19 and various fixed data. The CPU 19 uses the main memory 20 and the program memory 21 to execute a control operation in the data projector device 1.

The CPU 19 executes various projection operations in accordance with key operation signals from the operation unit 22.
The operation unit 22 includes a key operation unit provided in the main body of the data projector device 1 and an infrared light receiving unit that receives infrared light from a remote controller (not shown) dedicated to the data projector device 1. A key operation signal based on the key operated by the key operation unit or the remote controller is directly output to the CPU 19.

  The CPU 19 is further connected to an audio processing unit 23 and a pointer communication unit 24 via the system bus SB1. The sound processing unit 23 includes a sound source circuit such as a PCM sound source, converts the sound data given during the projection operation into an analog signal, drives the speaker unit 25 to emit a loud sound, or generates a beep sound or the like as necessary.

  The pointer communication unit 24 is wirelessly connected to the point pen 2 through the antenna 26, and the detection signal according to the coordinate information sent from the point pen 2 and the external force applied to the point pen 2, and the point pen 2 It receives operation signals of various keys provided and sends them to the CPU 19.

  Next, a schematic functional configuration of the point pen 2 will be described with reference to FIG.

  In the figure, reference numeral 31 denotes a light receiving lens unit 31. When the light receiving lens unit 31 is opposed to the screen SC, the blinking of light at the spot position on the screen SC is captured by the light receiving lens unit 31 and imaged on the light receiving sensor 32. The light reception signal output from the light reception sensor 32 is sent to the light reception demodulation unit 33.

  The light receiving demodulator 33 obtains the two-dimensional position coordinates in the projected image on the screen SC on which the light receiving lens unit 31 is facing, by demodulating the received light signal after digitizing it. The position coordinate data is sent to the CPU 34 via the system bus SB2.

  The CPU 34 is directly connected to the main memory 35 and the program memory 36. The main memory 35 is composed of, for example, an SRAM and functions as a work memory for the CPU 34. The program memory 36 is composed of an electrically rewritable nonvolatile memory, and stores an operation program executed by the CPU 34, various fixed data, and the like. The CPU 34 executes the control operation in the point pen 2 using the main memory 35 and the program memory 36.

The CPU 34 executes various point operations in response to key operation signals from the key operation unit 37.
The key operation unit 37 includes, for example, a power key of the point pen 2, a click key used for a click operation, a number key for selecting a menu item when selecting an operation menu, and a key operation signal based on the key operation. Is directly output to the CPU 34.

The CPU 34 is further connected to a gyro sensor 38, a triaxial acceleration sensor 39, and a projector communication unit 40 via the system bus SB2.
The gyro sensor 38 is composed of, for example, a vibration type gyro sensor, detects an angular velocity from the Coriolis force applied to the vibration piece, and detects an angle when the point pen 2 is operated by an external force of the user.

  The three-axis acceleration sensor 39 detects acceleration including gravitational acceleration that works in a three-dimensional space. The movement speed of the point pen 2 is integrated by integrating the detected acceleration, and the movement speed is integrated by integrating the movement speed. The distance can be determined.

  Accordingly, by using the detection outputs of the gyro sensor 38 and the triaxial acceleration sensor 39, the CPU 34 can detect in what direction and in what size the point pen 2 is operated by the user.

  The projector communication unit 40 is wirelessly connected to the data projector device 1 side via the antenna 41, and the data projector device detects position coordinate data of the projection image, detection data detected by the gyro sensor 38, the triaxial acceleration sensor 39, and the like. Send to 1

Next, the operation of the above embodiment will be described.
The operation described below is executed based on the control of the CPU 19 in the data projector device 1 during the 3D image projection operation. The CPU 19 reads out the operation program and data stored in the program memory 21, develops and stores the operation program and data in the main memory 20, and executes the operation program.

  The operation program stored in the program memory 21 is stored in the program memory 21 at the time of shipment of the data projector apparatus 1 from the manufacturing factory. For example, when the data projector apparatus 1 is upgraded, the data projector apparatus 1 In this case, a new operation program or the like is installed from the outside by connecting to a personal computer via the USB interface 12 or by connecting a USB memory storing software for upgrading to a USB terminal.

FIG. 4 is a flowchart showing the processing contents corresponding to the operation of the point pen 2 for one image projected in the 3D image projection mode.
Initially, the CPU 19 performs a projection process on the screen SC of a 3D image corresponding to an image signal input from the input unit 11 or the USB interface 12 (step S101).

Then, the CPU 19 determines whether or not the projection end timing of the image has been reached due to reasons such as switching the image projected so far (step S102).
If it is determined that the end timing of the image has not yet been reached, the CPU 19 further determines whether or not there has been a key operation for drawing the point pen 2, for example, a click key operation, based on the reception status from the pointer communication unit 24. (Step S103).

  When determining that there is no drawing key operation for the point pen 2, the CPU 19 returns to the processing from step S101.

  If it is determined in step S103 that the key operation for drawing the point pen 2 has been performed, after confirming the contents of the position coordinate data received from the point pen 2 at that time (step S104), Based on whether or not the position coordinate data exists, it is determined whether or not the point pen 2 is currently pointing within the range of the projected image on the screen SC (step S105).

  Here, when it is determined that there is no position coordinate data and the point within the range of the projection image is not pointed out, it is assumed that drawing cannot be performed, and the key operation for drawing the point pen 2 is invalidated, Returning to the processing from step S101.

  If it is determined in step S105 that the position coordinate data is present and the point is within the range of the projection image, the CPU 19 again determines the position coordinate of the position pointed to by the projection image in synchronization with the projection timing of the left-eye image. Data is acquired (step S106).

  Subsequently, the CPU 19 acquires position coordinate data of the position pointed to in the projection image in synchronization with the projection timing of the right-eye image (step S107).

  Further, at that time, the angular velocity that is the detection output of the gyro sensor 38 in the point pen 2 is acquired (step S108), and the triaxial acceleration that is the detection output of the triaxial acceleration sensor 39 is acquired (step S109).

  Here, only when the drawing is the first point of continuous drawing, the initial position setting process is executed (step S110pre). In this initial position setting process, only the position coordinate data of the acquired point position of the image for the left eye and the position coordinate data of the point position of the image for the right eye are used to set the position in the depth direction as a reference (initial position). In this case, the detection output of each sensor is not used.

  This reference position (initial position) can be set by, for example, key operation of the point pen 2.

  Next, the CPU 19 uses the detected position output data of the point position of the image for the left eye, the position coordinate data of the point position of the image for the right eye, and the detection outputs of the gyro sensor 38 and the three-axis acceleration sensor 39 to execute the point pen at that time. By calculating which position in the image on which 2 is projected in 3D is pointed and at which time the point pen 2 is operated and in what size, the reference position (initial position) is calculated. The position coordinates in the three-dimensional space are calculated (step S110).

  In accordance with the calculation result, the CPU 19 creates 3D drawing data indicating the point position (step S111). When generating the 3D drawing data, the output of each sensor is invalidated only when the reference position (initial position) is set in step S110pre, and the reference position (initial position) is set to the start point (reference position) by the subsequent operation of the point pen 2. Drawing is performed as (dot).

  That is, the change in the depth direction from the start point after the second point is set by a preset parameter (sensitivity coefficient) for the detection output of each sensor.

  The drawing data created in this way is superimposed on the input image so as to overwrite the position and set in the display memory inside the projection processing unit 14 to perform the projection processing (step S112), and the processing from step S101 is performed. Return.

  The above operation itself is basically unrelated to the projected image information, but the created drawing data is displayed in a three-dimensional manner so as to correspond to the parallax of the projected stereoscopic image. You may do it.

  Further, by determining the image information of the input image projected at this time and the depth information of the stereoscopic image, it is possible to give a drawing effect representing the relationship with the input image to the drawing data.

  For example, consider a case in which a rectangular parallelepiped as shown in FIG. At this time, when the point-indicated position is considered to be positioned in front of the projected image in the three-dimensional space, drawing data with a preset color, for example, a yellow solid line is used. create.

  On the other hand, when the pointed position is considered to be inside (back side) from the surface of the image projected in the three-dimensional space, it is intentionally set in a preset color, for example, yellow. This is an operation for creating drawing data such as dotted lines formed by regularly arranging gaps.

  For example, when the user operates the point pen 2 so as to move the point pen 2 in parallel with the plane of the screen SC when pointing within the range of the image projected on the screen SC by the point pen 2, The operation state is determined by the detection outputs of the gyro sensor 38 and the triaxial acceleration sensor 39, and drawing is performed so as to completely overwrite the projected image.

  On the other hand, after pointing the projected image with the point pen 2, an operation of pushing the point pen 2 in a direction perpendicular to the screen SC plane (back side), or pointing the tip of the point pen 2 toward the back side of the screen SC plane When a swing-like operation with such a small width as to swing is performed, the direction and magnitude of the operation are determined by the detection outputs of the gyro sensor 38 and the triaxial acceleration sensor 39, and the projected image It is possible to draw a dotted line or the like that is buried inside.

  The drawing data for the image projected in this way is converted into vector data including information indicating the line type and position coordinates as needed corresponding to the image signal input from the input unit 11 or the USB interface 12, and is stored in the main memory. 20 is stored while being accumulated.

  However, when it is time to end the projection of the image that has been projected so far, such as when the image to be projected is switched or when the projection operation is terminated, this is determined in step S102.

  At this time, the CPU 19 collects the drawing data converted into vector data including the information indicating the line type and the position coordinates, which has been stored in the main memory 20 so far, and creates a drawing data file to be attached to the original image signal. Then, when the USB memory is attached to the USB terminal via the USB interface 12, the created file is stored in the USB memory (step S113).

  Thus, the process including the operation of the point pen 2 corresponding to one input image signal is finished, and the process proceeds to the same process for the next input image.

  In the above description of the operation, the point pen 2 is used to draw the projected image, and the operation position in the state where the click key of the point pen 2 is operated is described. Also, for example, by specifying any two or three points in the projection image, a straight line passing through the two or three points, or a plane (such as a cut surface with respect to a figure) is defined. Various operations that were not shown can be considered.

  As described above in detail, according to the present embodiment, it is possible to directly execute three-dimensional pointing, drawing, or the like corresponding to the three-dimensional image to be projected.

  In addition, in the above embodiment, if the parallax is given to the content operated by the user using the point pen 2 at the time of projection so as to correspond to the parallax of the input image signal, the input image signal can be matched. The taken point image can be superimposed.

  Furthermore, in the above-described embodiment, since the contents operated by the user using the point pen 2 at the time of projection can be stored for the input image signal, various information added to the image by the user at the projection stage can be stored. It can be digitized and used later.

  In the above embodiment, when the user performs drawing or the like on the projected image by operating the point pen 2, the aspect of the drawing portion that is projected by the position in the three-dimensional space according to the operation, for example, the type of line Since the projection is performed by changing, etc., the point operation of the three-dimensional image can be realized using more various expressions.

  Although the above embodiment is an example applied to a 3D projection system including a DLP (registered trademark) type data projector apparatus, the present invention is not limited to the projector system and the like, for example, a projector apparatus using a color liquid crystal panel. The same applies to systems including

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

The invention described in the claims of the present application of the present application will be appended below.
The invention according to claim 1 is a projection system having a projection device and a point device for designating an arbitrary position in an image projected by the projection device, and the point device is for the left eye projected by the projection device. When a point operation is performed toward the image and the right-eye image, position acquisition means for reading and demodulating information indicating each position coordinate superimposed on each image, and a direction of an external force applied to the apparatus during the point operation, and Operation detection means for detecting the magnitude, information indicating each position coordinate obtained by the position acquisition means, and information indicating the direction and magnitude of the external force detected by the operation detection means are transmitted to the projection apparatus. The projection apparatus includes: an input unit that inputs an image signal; and an image for left eye that corresponds to the image signal input by the input unit and in which invisible position coordinate information is superimposed on each of the image signals. Projection means for projecting the image for the right eye, information indicating the position coordinates of the image for the left eye and the image for the right eye, and information indicating the direction and magnitude of the external force sent from the transmission means of the point device Based on the information received by the receiving means, position calculating means for calculating a designated position in the three-dimensional space of the image projected by the projecting means, and 3 calculated by the position calculating means. Projection control means for adding a predetermined point image to an image projected by the projection means according to a designated position in a dimensional space and projecting the image.

  According to a second aspect of the invention, in the first aspect of the invention, the projection control means of the projection device adds the predetermined point image to be projected so as to correspond to the parallax of the projected image signal. It is characterized by.

  According to a third aspect of the present invention, in the first or second aspect of the invention, the projection apparatus includes a holding unit that holds an image signal indicating a point image to be projected in addition to the projection control unit, and the projection unit. The image processing apparatus further includes storage means for storing an image signal indicating a series of projected point images in addition to the image held by the holding means when the image to be projected is switched.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects, the projection control means of the projection device further adds a predetermined point image to be projected according to the image projected by the projection means. It is characterized in that the mode of the above is variable.

  The invention according to claim 5 is a projection device that uses a point device for designating an arbitrary position in a projection image at the time of projection, and corresponds to the input means for inputting an image signal and the image signal input by the input means. Projecting means for projecting a left-eye image and a right-eye image on which invisible position coordinate information is superimposed, and information indicating the position coordinates of the left-eye image and the right-eye image sent from the point device; , Receiving means for receiving information indicating the direction and magnitude of the external force applied to the pointer device, and designation in the three-dimensional space of the image projected by the projection means based on the information received by the receiving means A position calculating means for calculating a position, and a projection control means for projecting by adding a predetermined point image to the image projected by the projecting means according to the designated position in the three-dimensional space calculated by the position calculating means Characterized by comprising and.

  The invention according to claim 6 corresponds to an input unit for inputting an image signal, which uses a point device for designating an arbitrary position in a projected image at the time of projection, and an image signal input from the input unit, and is invisible to each of them. A projection method in a device including a projection unit that projects a left-eye image and a right-eye image on which position coordinate information is superimposed, and each position of a left-eye image and a right-eye image sent from the point device A receiving step for receiving information indicating coordinates and information indicating the direction and magnitude of an external force applied to the pointer device, and 3 of the image projected by the projection unit based on the information received in the receiving step. A position calculating step for calculating a specified position in the three-dimensional space, and a projection for adding a predetermined point image to the image projected by the projection unit according to the specified position in the three-dimensional space calculated in the position calculating step. Characterized in that and a control step.

  The invention according to claim 7 corresponds to an input unit for inputting an image signal, which uses a point device for designating an arbitrary position in a projection image at the time of projection, and an image signal input from the input unit, and is invisible to each of them. A program executed by a computer built in a device including a projection unit that projects a left-eye image and a right-eye image on which position coordinate information is superimposed, and the computer is sent from the point device. Based on the information received by the receiving means, receiving means for receiving information indicating the position coordinates of the image and the right-eye image and information indicating the direction and magnitude of the external force applied to the pointer device, Projecting by the projection unit according to the position calculating means for calculating the designated position in the three-dimensional space of the projected image and the designated position in the three-dimensional space calculated by the position calculating means Characterized in that to function as the projection control means to project by adding a given point image in the image.

  DESCRIPTION OF SYMBOLS 1 ... Data projector apparatus, 2 ... Point pen, 3 ... 3D glasses, 11 ... Input part, 12 ... USB interface (I / F), 13 ... Image conversion part, 14 ... Projection process part, 15 ... Micromirror element, 16 DESCRIPTION OF SYMBOLS ... Light source part, 17 ... Mirror, 18 ... Projection lens part, 19 ... CPU, 20 ... Main memory, 21 ... Program memory, 22 ... Operation part, 23 ... Sound processing part, 24 ... Pointer communication part, 25 ... Speaker part, 26 ... Antenna, 31 ... Light receiving lens part, 32 ... Light receiving sensor, 33 ... Light receiving demodulation part, 34 ... CPU, 35 ... Main memory, 36 ... Key operation part, 37 ... Key operation part, 38 ... Gyro sensor, 39 ... 3 Axis acceleration sensor, 40 ... projector communication unit, 41 ... antenna, SB1, SB2 ... system bus, SC ... screen.

Claims (7)

A projection system having a projection device and a point device for designating an arbitrary position in an image projected by the projection device,
The point device
Position acquisition means for reading and demodulating information indicating each position coordinate superimposed on each image when the point operation is performed toward the left-eye image and the right-eye image projected by the projection device;
Operation detecting means for detecting the direction and magnitude of an external force applied to the device during the point operation;
Transmission means for transmitting information indicating the position coordinates obtained by the position acquisition means and information indicating the direction and magnitude of the external force detected by the operation detection means to the projection device;
The projection apparatus is
An input means for inputting an image signal;
Projecting means for projecting a left-eye image and a right-eye image corresponding to the image signal input by the input means, each of which is superimposed with invisible position coordinate information,
Receiving means for receiving information indicating the position coordinates of the image for the left eye and the image for the right eye and information indicating the direction and magnitude of the external force sent from the transmission means of the point device;
Position calculating means for calculating a designated position in the three-dimensional space of the image projected by the projection means based on the information received by the receiving means;
A projection system comprising: a projection control unit that projects a predetermined point image in an image projected by the projection unit according to a specified position in the three-dimensional space calculated by the position calculation unit.   The projection system according to claim 1, wherein the projection control unit of the projection apparatus adds the predetermined point image to be projected so as to correspond to the parallax of the projected image signal. The projection apparatus is
Holding means for holding an image signal indicating a point image to be projected in addition to the projection control means;
2. The image processing apparatus according to claim 1, further comprising a storage unit configured to store an image signal indicating a series of point images projected in addition to the image held by the holding unit when the image projected by the projection unit is switched. Or the projection system of 2.   4. The projection system according to claim 1, wherein the projection control unit of the projection apparatus changes a mode of a predetermined point image to be projected according to an image projected by the projection unit. 5. . A projection device that uses a point device for designating an arbitrary position in a projection image at the time of projection,
An input means for inputting an image signal;
Projecting means for projecting a left-eye image and a right-eye image corresponding to the image signal input by the input means, each of which is superimposed with invisible position coordinate information,
Receiving means for receiving information indicating the position coordinates of the image for the left eye and the image for the right eye, and information indicating the direction and magnitude of the external force applied to the pointer device, sent from the point device;
Position calculating means for calculating a designated position in the three-dimensional space of the image projected by the projection means based on the information received by the receiving means;
A projection apparatus comprising: a projection control unit that projects a predetermined point image in an image projected by the projection unit according to a specified position in the three-dimensional space calculated by the position calculation unit. A point device that specifies an arbitrary position in the projected image is used at the time of projection, an input unit for inputting an image signal, and an image signal input by the input unit for the left eye on which invisible position coordinate information is superimposed. A projection method in an apparatus including a projection unit that projects an image and a right-eye image,
A receiving step of receiving information indicating the position coordinates of the image for the left eye and the image for the right eye, and information indicating the direction and magnitude of the external force applied to the pointer device, sent from the point device;
A position calculating step of calculating a designated position in the three-dimensional space of the image projected by the projection unit based on the information received in the receiving step;
A projection control step of projecting a predetermined point image to an image projected by the projection unit according to a specified position in the three-dimensional space calculated in the position calculation step. A point device that specifies an arbitrary position in the projected image is used at the time of projection, an input unit for inputting an image signal, and an image signal input by the input unit for the left eye on which invisible position coordinate information is superimposed. A program executed by a computer built in an apparatus including a projection unit that projects an image and a right-eye image,
The above computer
Receiving means for receiving information indicating the position coordinates of the image for the left eye and the image for the right eye, and information indicating the direction and magnitude of the external force applied to the pointer device, sent from the point device;
Based on the information received by the receiving means, a position calculating means for calculating a specified position in the three-dimensional space of the image projected by the projection unit, and a specified position in the three-dimensional space calculated by the position calculating means. A program that functions as a projection control unit that projects a predetermined point image in an image projected by the projection unit.

Images