JP2013196475A - Projection device, projection method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To avoid deterioration of an image as much as possible in response to use state of a special purpose point pen.SOLUTION: A projection device includes: a light source part 15 having light emitters of multiple colors; an input/output part 11 for inputting an image signal; projection systems 13, 14, 16 and 17 for forming and projecting an optical image corresponding to the image signal input at the input/output part 11 in response to light color by using light emitted in time division for each color field from the light source part 15; and a CPU 18 for inserting an optical image corresponding to a position detection image for detecting a position in the light source part 15 instead of the optical image corresponding to the image signal input by the input/output part 11, causing the projection system 13, 14, 16 and 17 to project it, causing a pointer communication part 23 and an antenna 25 to transmit information instructing to detect positional coordinates at the projection timing to a point pen 3, and causing the pointer communication part 23 and the antenna 25 to receive information on the positional coordinates transmitted from the point pen 3 in response to the transmission, while determining a frequency for inserting an optical image corresponding to the position detection image in one frame of a color image and causing projection.

Description

  The present invention relates to a projection apparatus, a projection method, and a program suitable for a DLP (registered trademark) projector using a dedicated point pen.

  In order to accurately detect the position indicated by the laser beam or the like in the projection image projected on the screen, an area sensor that images the screen and a laser beam that is emitted from the laser pointer to the area sensor are input to a color-sequential projector. An area sensor unit composed of an optical filter or the like that uses only R light of the same color and a timing extraction unit that extracts R, G, and B projection timings are provided, and the projection timing of the R image arrives during the explanation image projection period. Then, even if there is a portion of the same color as the laser beam in the projected image by letting the MPU perform a process of picking up an image of the screen at that time and detecting the indicated position indicated by the laser beam based on the picked-up image A technique for enabling detection of the indicated position is considered. (For example, Patent Document 1)

JP 2004-110797 A

  In order to detect the pointing position with a projector using a general-purpose laser pointer or other pointing device, including the technique described in the above-mentioned patent document, an imaging unit such as an area sensor for shooting a projected image on the projector side Is necessary, and the configuration of the apparatus is complicated and the cost increases.

  Recently, in a DLP (registered trademark) projector, an environment that can be used like a laser pointer is realized by using a dedicated pointer pen. This type of dedicated pointer pen includes a light receiving sensor unit that detects the brightness of a spot-like minimum range and a communication unit that transmits and receives control signals to and from the projector body.

  The projector main body projects each gradation image for X and Y coordinate detection in an extremely short period on the original projected image, and instructs the dedicated point pen to detect luminance. The dedicated point pen executes luminance detection according to the instruction timing from the projector main body, converts the detection result into coordinate data, and transmits it to the projector main body. The projector body projects the coordinate data sent from the dedicated point pen by superimposing the pointer image on the corresponding position in the projected image according to the received coordinate data, and as if the beam emitted from the dedicated point pen. Light appears on the projected image and appears to specify the position.

  In order to use this type of dedicated point pen, the gradation image projected in a very short time by the projector body sandwiched between the original projection images, for example, one of the left end and the right end for X coordinate detection is brightest and the other is the most One set of two images is a dark gradation image, and one of the upper and lower ends for detecting the y coordinate is the brightest and the other image is the darkest gradation.

  However, when a set of gradation images is inserted, the afterimage that combines the two images changes in luminance obliquely along one diagonal line of the original projected image. Two pairs of gradation images are inserted as basic units in pairs with images whose tone change directions are opposite to each other.

  When the above-described gradation image is inserted for detecting the designated position of the dedicated point pen, it is necessary to insert the gradation image into the original projection image at a higher frequency in order to improve the tracking performance of the point pen.

  When the gradation image is inserted at a higher frequency (for a long time) as such, the person who recognizes the image (viewer) recognizes the gradation image that is not related to the projection image together with the original projection image. In this case, the time used for the gradation expression of the projected image is shortened by that amount, and the projected image is diluted by the gradation image, so that the contrast of the projected image is lowered.

  In particular, when the original projected image itself has many dark gradations, the dark portion of the image, which is so-called “white floating”, is recognized as an image that is unnaturally bright or has an unbalanced color balance. There is a problem that.

  The present invention has been made in view of the above circumstances, and an object of the present invention is to provide a projection apparatus, a projection method, and a program capable of setting an appropriate operating environment in accordance with a situation where a point pen is used. Is to provide.

  One embodiment of the present invention uses a light source having light emitting elements of a plurality of colors, input means for inputting an image signal, and light transmitted from the light source in a time division for each color field, depending on the color of the light. Projection means for forming and projecting a light image corresponding to the image signal input by the input means, and projection means for inserting a light image corresponding to a position detection image for detecting a position in the light image. The projection control means for projecting the image and the information for instructing the detection of the position coordinates at the timing when the projection control means projects the light image corresponding to the position detection image by the projection means to the point device outside the apparatus. A transmission unit; a reception unit that receives information about the position coordinates transmitted from the point device in response to transmission by the transmission unit; and the projection control unit that corresponds to the position detection image in one frame of the color image. Characterized in that by inserting an optical image comprises a determination means for determining the frequency of projecting to.

  According to the present invention, it is possible to set an appropriate operating environment according to the situation in which the point pen is used.

The figure which shows the connection structure of the projection system which concerns on one Embodiment of this invention. FIG. 2 is a block diagram showing a functional configuration of the data projector apparatus according to the embodiment. The block diagram which shows the function structure of the point pen which concerns on the same embodiment. FIG. 2 is a block diagram showing a hardware configuration of the PC according to the embodiment. 6 is a flowchart mainly showing processing contents related to image setting for pointer position detection according to the embodiment. The flowchart of the subroutine which shows the processing content of the automatic setting process of FIG. 5 which concerns on the embodiment. The figure explaining the normal sequence which does not insert the image for position detection concerning the embodiment. The figure explaining the sequence which inserts the image for position detection concerning the embodiment 3 times. The figure explaining the sequence which inserts the image for position detection concerning the embodiment twice. The figure explaining the sequence which inserts the image for position detection concerning the embodiment once. The figure for demonstrating the content of the normal (gamma) correction conditions and the (gamma) correction conditions 1-1 (and (gamma) correction conditions 1-2) based on the embodiment. The figure for demonstrating the content of the (gamma) correction condition 2 which concerns on the same embodiment. The figure for demonstrating the content of the (gamma) correction condition 2 which concerns on the same embodiment.

Hereinafter, an embodiment in which the present invention is constructed by connecting a PC to a DLP (registered trademark) data projector apparatus and constructing a projection system will be described with reference to the drawings.
FIG. 1 illustrates the connection configuration of the projection system according to the present embodiment. In the figure, 1 is a projector and 2 is a PC that provides an image to be projected onto the projector 1. The projector 1 and the PC 2 are connected by wire with a VGA cable VC and a USB cable UC. An image signal is provided from the PC 2 via the VGA cable VC, and the projector 1 projects a projection image PI corresponding to the image signal onto the screen.

  Reference numeral 3 denotes a point pen dedicated to the projector 1, and the projector 1 and the point pen 3 are wirelessly connected by, for example, Bluetooth (registered trademark) technology. The projection image PI projected by the projector 1 includes a position detection image in a time division manner in addition to the image provided from the PC 2.

  The point pen 3 includes a communication system circuit with the projector 1 and an arithmetic circuit that calculates position coordinates from the received light intensity (brightness). The point pen 3 receives a luminance detection instruction from the projector 1, and the light receiving unit of the point pen 3 A position coordinate is calculated from the luminance of the point position in the projected image PI that is faced, and is transmitted to the projector 1 as coordinate information (position coordinates) of the point instruction.

Based on the received coordinate information of the point pen 3, the projector 1 generates and projects an image signal such that the image of the point mark PT is superimposed on the projection image PI.
Therefore, the user holding the point pen 3 can operate the point pen 3 as if the light having the shape of the point mark PT is emitted directly from the point pen 3.

FIG. 2 is a diagram showing a schematic functional configuration of the projector 1.
The input / output unit 11 includes, for example, a video input terminal, an RGB input terminal, a VGA terminal, a USB terminal for connecting to a PC, and the like. The image signal input to the input / output unit 11 is digitized as necessary, and then sent to the image conversion unit 12 via the system bus SB.

  The image conversion unit 12 is also referred to as a scaler, and the input image data is unified into image data of a predetermined format suitable for projection and sent to the projection processing unit 13.

  At this time, data such as symbols indicating various operating states for OSD (On Screen Display) including the point mark PT is also superposed on the image data by the image conversion unit 12 as necessary, and the processed image data is projected. The data is sent to the processing unit 13.

  The projection processing unit 13 multiplies a frame rate according to a predetermined format, for example, 120 [frames / second], the number of color component divisions, and the number of display gradations, in accordance with the transmitted image data. The micromirror element 14 that is a spatial light modulation element is driven to display by the time-division driving.

  This micromirror element 14 is turned on / off individually at a high speed for each inclination angle of a plurality of micromirrors arranged in an array, for example, WXGA (Wide eXtended Graphics Array) (horizontal 1280 pixels × vertical 800 pixels). By displaying the image, an optical image is formed by the reflected light.

  At this time, the image displayed by the micromirror element 14 includes the point position detection image of the point pen 3 at an appropriate frequency in time division instead of the image corresponding to the image signal input by the input / output unit 11. It is. Details will be described later.

  On the other hand, light of a plurality of colors including primary color lights of R, G, and B is sequentially emitted in a time division manner from the light source unit 15 in a time division manner. The light from the light source unit 15 is totally reflected by the mirror 16 and applied to the micromirror element 14.

  Then, a light image corresponding to the color of the light source light is formed by the reflected light from the micromirror element 14, and the formed light image is projected and displayed on a screen (not shown) to be projected through the projection lens unit 17. Is done.

  The light source unit 15 emits W (white) light by causing the R, G, and B light source elements to emit light simultaneously, if necessary, in addition to the R, G, and B primary color lights. It is assumed that a monochrome image can be projected.

  The CPU 18 controls all the operations of the above circuits. The CPU 18 is directly connected to the main memory 19 and the program memory 20. The main memory 19 is composed of, for example, an SRAM and functions as a work memory for the CPU 18. The program memory 20 is composed of an electrically rewritable nonvolatile memory, and stores an operation program executed by the CPU 18 and various fixed data. The CPU 18 uses the main memory 19 and the program memory 20 to perform overall control operations in the projector 1.

  The CPU 18 performs various projection operations according to key operation signals from the operation unit 21. The operation unit 21 includes a key operation unit provided in the main body of the projector 1 and an infrared light receiving unit that receives infrared light from a remote controller (not shown) dedicated to the projector 1. A key operation signal based on the key operated by the remote controller is directly output to the CPU 18.

The CPU 18 is further connected to an audio processing unit 22 and a pointer communication unit 23 via the system bus SB. The sound processing unit 22 includes a sound source circuit such as a PCM sound source, converts the sound data given during the projection operation into an analog signal, drives the speaker unit 24 to emit a loud sound, or generates a beep sound or the like as necessary.
The pointer communication unit 23 is wirelessly connected to the point pen 3 via the antenna 25, receives coordinate information sent from the point pen 3, operation signals of various keys provided in the point pen 3, and the like to the CPU 18. Send it out.

Next, the functional configuration of the point pen 3 will be described with reference to FIG.
A light receiving lens system 31 is incorporated at the tip of the point pen 3, and a phototransistor 32, for example, is disposed as a light receiving element at a focus position of the light receiving lens system 31. The output signal of the phototransistor 32 is digitized by the A / D converter 33 and then sent to the coordinate calculator 35 via the demodulator 34.

  The coordinate calculation unit 35 calculates and checks the position coordinates representing the point position of the point pen 3 in the projection image PI from the output of the demodulation unit 34 and outputs the calculation result to the CPU 36 via the bus B.

  The CPU 36 controls the A / D conversion unit 33, the demodulation unit 34, the coordinate calculation unit 35, and the control operation related to the entire point pen 3, and the main memory 37 and the program memory 38 are directly connected to each other. The main memory 37 functions as a work memory for the CPU 36. The program memory 38 stores an operation program executed by the CPU 36 and various fixed data. The CPU 36 executes the control operation in the point pen 3 using the main memory 37 and the program memory 38.

  Further, a key operation signal is input from the click key unit 39 to the CPU 36. The click key unit 39 outputs an operation signal of each of the two click keys arranged along the axial direction of the point pen 3 to the CPU 36, for example.

  Here, the two click keys constituting the click key unit 39 are, for example, as shown in FIG. 1, the click key 3a (corresponding to the left click key of the mouse pointer) located on the tip side of the point pen 3 and having a larger operation area. And a relatively small click key 3b (corresponding to the right click key of the mouse pointer) located on the rear side adjacent to the key.

  Further, the CPU 36 is also connected to the projector communication unit 40 via the bus B. This projector communication unit 40 is wirelessly connected to the projector 1 via the antenna 41, receives information instructing luminance detection from the projector 1, and is calculated based on the luminance acquired at the designated timing. And an operation signal of the click key unit 39 is transmitted to the projector 1.

  FIG. 4 shows the hardware configuration of the PC 2. The north bridge 52 is connected to the CPU 51 that controls various processes and the front side bus FSB.

  The north bridge 52 is connected to a main memory 53 via a memory bus MB, a graphics accelerator 54 and a graphic memory 55 via a graphics interface AGP, and a display 56 via a display connector (not shown). Then, an analog image signal is output via an RGB output terminal (not shown).

  Further, the north bridge 52 is also connected to the south bridge 57, and mainly performs input / output control between them.

  The south bridge 57 is connected to a PCI-Express slot 58, a keyboard / mouse 59, a hard disk device (HDD) 60, an optical disk drive 61, a network connector 62, and a USB connector 63. Input / output control between.

  It is assumed that an OS (operating system), various application programs, various data files, and the like are installed in the hard disk device 60 in advance.

  In addition, since the individual elements constituting the PC 2 are very general well-known techniques, the description thereof will be omitted.

Next, the operation of the above embodiment will be described with reference to FIGS.
FIG. 5 is a flowchart mainly showing processing contents related to image setting for pointer position detection according to an embodiment of the present invention, and FIG. 6 is a flowchart of a subroutine showing processing contents of automatic setting processing of FIG. 5 according to the embodiment. is there.

  FIG. 7 is a diagram illustrating a normal sequence in which the position detection image according to the embodiment is not inserted, FIG. 8 is a diagram illustrating a sequence in which the position detection image according to the embodiment is inserted three times, and FIG. FIG. 10 is a diagram for explaining a sequence for inserting the position detection image according to the embodiment twice. FIG. 10 is a diagram for explaining a sequence for inserting the position detection image according to the embodiment once.

  FIG. 11 is a diagram for explaining the contents of the normal γ correction condition and γ correction condition 1-1 (and γ correction condition 1-2) according to the embodiment, and FIGS. It is a figure for demonstrating the content of the (gamma) correction condition 2 which concerns on a form.

  FIG. 5 shows the CPU 18 and the projection processing unit 13 under the control of the CPU 18 in the projector 1 that projects the image signal from the PC 2 in the process of operating the projection system as shown in FIG. A part of the processing contents relating to the frequency setting of the point position detection image mainly executed by the point pen 3 is shown.

  As shown in the figure, in the program, the CPU 18 determines whether or not a setting menu selection operation has been performed by a key input signal from the operation unit 21 (step S101).

  If it is determined that the setting menu selection operation is not performed, the CPU 18 uses the image signal input from the input / output unit 11 at that time, and uses the point pen 3 according to the contents set at that time. After performing the projection operation taking into account the frequency of inserting the position detection image (step S102), the process returns to step S101 again.

  In this way, the CPU 18 repeatedly executes the processes of steps S101 and S102, and executes the projection operation while waiting for the setting menu setting operation to be performed.

  When a key input for selecting a setting menu is made on the operation unit 21, the CPU 18 determines that in step S101, and replaces the image according to the image signal input from the input / output unit 11 that has been projected so far. Then, an image listing each item of the setting menu is displayed on the micromirror element 14, and the optical image is projected by the projection lens unit 17 (step S103).

  Each item of the setting menu may be displayed so as to be superimposed (synthesized) on the image according to the image signal input from the input / output unit 11.

  Here, as a menu item that can be set, a mode for a point pen is provided together with other various setting modes, and whether or not the point pen 3 is used during the mode, the followability of the point mark and the image quality when the point pen 3 is used. It includes manual / automatic setting by the user regarding the frequency of insertion of the position detection image regarding the balance of the position, setting regarding the balance between the point mark followability and image quality in the case of manual setting, and the like.

  When any selection operation is performed in a state where the selection image of the setting menu is projected, the CPU 18 first determines whether or not the content related to the point pen mode is set according to the key input from the operation unit 21. (Step S104).

  If it is determined that the content set here is not the content related to the point pen mode, the CPU 18 performs the operation setting corresponding to the set content (step S105). The settings other than the point pen mode are not directly related to the present invention, and the description thereof is omitted. The CPU 18 returns to the processing from step S101 again after the setting operation is completed.

  If the content related to the point pen mode is set, the CPU 18 determines this in step S104, and then determines whether or not the setting to use the point pen 3 has been made (step S106).

  If it is determined that the setting to use the point pen 3 is not made, the CPU 18 does not use the position detection image of the point pen 3 but uses only the image based on the image signal input from the input / output unit 11. The normal sequence to be selected is selected and set (step S107).

  This normal sequence is schematically shown in FIG.

  At the same time, the CPU 18 selects and sets a normal γ correction condition (see FIG. 11A) that does not particularly perform intermediate emphasis for the gradation representation of each of the R, G, and B colors (step S108). Assuming that the menu selection operation has been completed, the process returns to step S101.

  If it is determined in step S106 that the setting to use the point pen 3 has been made, the CPU 18 next determines whether or not the user is in a manual setting state regarding the followability of the point mark to the operation of the point pen 3 or the like. Is determined (step S109).

  If it is determined that the manual setting state is set by the user, the CPU 18 then determines whether or not the setting that gives the highest priority to the followability of the point mark with respect to the operation of the point pen 3 has been made (step S110).

  If the CPU 18 determines that the highest priority is given to the followability of the point mark, the CPU 18 outputs from the input / output unit 11 at the end of the field in each of the R, G, and B fields constituting one frame of the color image. Instead of an image based on an image signal, a sequence for inserting a position detection image is selected and set (step S111).

  This sequence is schematically shown in FIG.

With this setting, the position detection process of the point pen 3 is executed three times while one color image frame is projected.
In this case, the position detection process is performed once, for example, in the first gradation image in which the uppermost edge is the brightest full gradation and the lowermost edge is the darkest “0 (zero)” gradation along the vertical direction of the screen. A second gradation image in which the leftmost edge has the brightest full gradation and the rightmost edge has the darkest “0 (zero)” gradation along the horizontal direction, and the darkest “0 ( "Zero)" gradation, third gradation image with brightest full gradation at the bottom end, darkest "0 (zero)" gradation at the leftmost end along the horizontal direction of the screen, full gradation at the rightmost end A total of four gradation images (position detection images) of the fourth gradation image are inserted and projected at the end of each field as a set, and a point pen is used at a predetermined timing from the start of projection for each gradation image projection. Against 3 It transmits information for specifying the brightness detection.

  In FIG. 8, the description of the third gradation image and the fourth gradation image is omitted for the sake of simplicity, but actually, the first gradation image, the second gradation image, and the like, respectively. It is assumed that the setting is made so that the direction in which the brightness changes is reversed.

  Here, the first gradation image and the third gradation image, and the second gradation image and the fourth gradation image are set so that the direction in which the luminance changes is inverted.

  That is, if it is simply to detect the X and Y coordinates of the point position in the image, one of the first gradation image and the third gradation image, and one of the second gradation image and the fourth gradation image. Coordinate detection is possible in principle by using a total of two gradation images whose luminance change directions are orthogonal to each other.

  However, in this type of field sequential color image projection using human afterimages, the luminance change direction is along one diagonal of the rectangle due to the afterimage effect of the two gradation images. Adversely affected.

  Therefore, the brightness of the projection environment is calculated by canceling out the brightness gradient in the screen by using a total of four gradation images, each of which changes in luminance, and calculating the difference between the detected values from the inverted images. Since the components can also be canceled out, it contributes to the improvement of the detection accuracy of the position coordinates.

  The point pen 3 detects the luminance at the timing according to the instruction information sent from the projector 1, and displays the screen from each luminance information obtained by the total four detections of the first to fourth gradation images for each instruction information. The X and Y coordinate positions pointed at are calculated, and the calculated coordinate information is returned to the projector 1.

  Then, the projector 1 can determine the coordinates of the point position of the point pen 3 according to the coordinate information returned from the point pen 3 after a certain delay time.

  Here, coordinate information of point positions for three points in a time series can be acquired for one color image frame. Further, the CPU 18 may perform smoothing processing of the acquired coordinates as appropriate to prevent unnecessary fine vibrations in the image. Then, the CPU 18 projects the point mark PT at the position of the coordinate information obtained by superimposing on the image projection according to the image signal from the input / output unit 11.

  At the same time, the CPU 18 sets γ correction conditions that particularly emphasize the intermediate gradation for each of the R, G, and B pixel gradations in accordance with the γ correction condition 1-1 stored in advance in the program memory 20 ( In step S112), it is assumed that the series of processes related to the setting menu selection operation has been completed, and the process returns to step S101.

  FIG. 11 is a diagram for explaining the contents of the γ correction condition 1-1. That is, when FIG. 11A represents the output gradation after γ correction with respect to the normal input gradation, the γ correction condition 1-1 shows that (the wavy line portion) as shown in FIG. Is the same γ characteristic as in FIG. 11A), in particular, by setting the curvature of the S-shaped curve to be increased (extend the halftone) so that the degree of change in the intermediate gradation region is increased, R, Settings are made so as to enhance the contrast in all the G and B fields.

  The degree of emphasis of the γ correction condition 1-1 may be changed according to the ratio of the position detection image insertion time in one frame.

  In other words, in the present embodiment, in addition to the γ correction processing that is normally performed by the image conversion unit 12, correction that enhances the contrast that is diluted by inserting the position detection image into each of the R, G, and B fields. Are to be executed together.

  If it is determined in step S110 that the setting that gives the highest priority to the followability of the point mark is not made, the CPU 18 then determines whether the setting of giving more priority to the followability is made by the balance between the followability of the point mark and the image quality. It is determined whether or not (step S113).

  If it is determined that priority is given to followability, the CPU 18 determines the field in each of the R, G fields excluding the B field among the R, G, B fields constituting one frame of the color image. At the end, a sequence for inserting the position detection image is selected and set instead of the image based on the image signal from the input / output unit 11 (step S114).

  This sequence is schematically shown in FIG.

With this setting, the position detection process of the point pen 3 is executed twice while one color image is projected.
As shown in FIG. 9, when one frame of a color image is composed of R, G, and B fields, a total of 3 fields, once at the end of the R field and once at the end of the G field, The position detection process is executed twice in total.

  In this case, the position detection process is performed once, for example, in the first gradation image in which the uppermost edge is the brightest full gradation and the lowermost edge is the darkest “0 (zero)” gradation along the vertical direction of the screen. A second gradation image in which the leftmost edge has the brightest full gradation and the rightmost edge has the darkest “0 (zero)” gradation along the horizontal direction, and the darkest “0 ( "Zero)" gradation, third gradation image with brightest full gradation at the bottom end, darkest "0 (zero)" gradation at the leftmost end along the horizontal direction of the screen, full gradation at the rightmost end A total of four gradation images of the fourth gradation image to be inserted are inserted and projected at the end of each field as a set, and the luminance is detected with respect to the point pen 3 at a predetermined timing from the start of projection for each gradation image projection. Indicate To transmit information.

  In FIG. 9, the description of the third gradation image and the fourth gradation image is omitted for the sake of simplicity, but actually, the first gradation image, the second gradation image, and the like, respectively. It is assumed that the setting is made so that the direction in which the brightness changes is reversed.

  The point pen 3 detects the luminance at the timing according to the instruction information sent from the projector 1, and displays the screen from each luminance information obtained by the total four detections of the first to fourth gradation images for each instruction information. The X and Y coordinate positions pointed at are calculated, and the calculated coordinate information is returned to the projector 1.

  The projector 1 can determine the coordinates of the point position of the point pen 3 based on the coordinate information returned from the point pen 3 after a certain delay time.

  Here, the coordinate information of the point positions for two points in a time series with respect to one color image frame can be acquired. Further, the CPU 18 may perform a smoothing process on the acquired coordinates to prevent unnecessary fine vibrations in the image. Then, the CPU 18 projects the point mark PT at the position of the coordinate information obtained by superimposing on the image projection according to the image signal from the input / output unit 11.

  At the same time, according to the γ correction condition 2 stored in advance in the program memory 20, the CPU 18 increases the γ correction so as to raise the gradation on the dark side close to the “0 (zero)” gradation in each pixel gradation of B. The conditions are set (step S115), and it is assumed that the series of processing related to the selection operation of the setting menu has been completed.

  FIG. 12 is a diagram for explaining the content of the γ correction condition 2. In other words, the B image in the B field has a dark portion side gradation close to the “0 (zero)” gradation, as shown by the solid line in FIG. 12, unlike the R and G images in the R and G fields. γ correction for the input gradation is performed after raising the level by b.

  In the R and G images, γ correction is performed for an input gradation that does not increase by b as shown by the wavy line in FIG.

  For the R and G images, a setting is made to increase the curvature of the S-shaped curve so that the degree of change in the intermediate gradation region is increased to compensate for the decrease in contrast that occurs with the insertion of the position detection image. You may make it perform.

  FIG. 13 is a diagram for more specifically explaining the situation on the dark side near the “0 (zero)” gradation of the same γ correction.

  For the R and G images, correction along the curve of γ correction is performed, while for the B image, the output gradation is uniformly set from zero gradation to a certain gradation, for example, “(8)”. The gradation is not “(0)” but “(3)”.

  In addition, in the γ correction on the “0 (zero)” gradation side of the blue color complementary to the above yellow, by selecting a gradation range corresponding to the energy due to the insertion of the position detection image, Both are offset to make a gray color with complementary colors.

  By executing such γ correction processing and inserting the position detection image of the point pen 3 in each of the R and G fields, a dark image whose original projected image is close to (zero) gradation is projected. Even in a situation where the image is expressed as a mixed color yellow floating image due to the position detection image in each of the R and G fields at the power timing, the “0 (zero)” floor in the B field which is a complementary color By projecting with the key raised to the bottom, the color that is easily perceived by the naked eye will be offset and an achromatic gray image will be projected, resulting in an image projection with an unnatural description for the user. Can be avoided.

  Further, such a γ correction process for the B image is performed for a reason different from the original purpose (projection with color balance according to the system system). However, when a normal bright image is projected, the position detection image is used. The luminance level of the yellow component due to the insertion is relatively low, and the image quality is hardly affected.

  That is, here, in addition to the γ correction processing normally performed by the image conversion unit 12, an image that has a yellow color due to the insertion of the position detection image only in the R and G fields is converted into a blue color having a complementary color relationship with yellow. At the time of γ correction, correction is also performed in such a manner that the level is raised from zero gradation to a constant gradation to a uniform value.

  The reason why the setting is made so that the position detection image of the point pen 3 is not inserted in the B field in step S114 will be described.

  Since B is the darkest image with the lowest luminance component among the three primary colors R, G, and B, the light quantity (luminance) received by the point pen 3 that detects the position is the highest among the three primary colors R, G, and B. This is because the detection distance that the point pen 3 can detect the coordinate information (positional coordinates) can be made longer than the setting not inserted in the field of other colors because it is dark and the detection accuracy is poor.

  In addition, by inserting a position detection image, the contrast of the original image of any color is lowered. However, since B is the darkest image with the lowest luminance component among the three primary colors R, G, and B, position detection is performed. It is desirable to select the B field from the viewpoint that the projection time of the image to be originally projected is shortened by inserting the image for use, and the color has the smallest influence on the contrast.

  If it is determined in step S113 that the setting for giving priority to followability has not been made in terms of the balance between the followability of the point mark and the image quality, the CPU 18 displays the three fields R, G, and B constituting one frame of the color image. In addition, a W (white) field is set, and a sequence for inserting a position detection image is selected and set in the W field in place of the image based on the image signal from the input / output unit 11 (step S116).

  This sequence is schematically shown in FIG.

With this setting, the position detection process of the point pen 3 is executed once while one color image frame is projected.
As shown in FIG. 10, when one frame of a color image is composed of R, G, B, and W fields, a total of 4 fields, the position detection process is executed only once in the W field.

  In this case, the position detection process is performed once, for example, in the first gradation image in which the uppermost edge is the brightest full gradation and the lowermost edge is the darkest “0 (zero)” gradation along the vertical direction of the screen. A second gradation image in which the leftmost edge has the brightest full gradation and the rightmost edge has the darkest “0 (zero)” gradation along the horizontal direction, and the darkest “0 ( "Zero)" gradation, third gradation image with brightest full gradation at the bottom end, darkest "0 (zero)" gradation at the leftmost end along the horizontal direction of the screen, full gradation at the rightmost end A total of four gradation images of the fourth gradation image to be inserted are inserted and projected at the end of each field as a set, and the luminance is detected with respect to the point pen 3 at a predetermined timing from the start of projection for each gradation image projection. Indicate To transmit information.

  In FIG. 10, the description of the third gradation image and the fourth gradation image is omitted for the sake of simplicity, but actually, the first gradation image, the second gradation image, and the like, respectively. It is assumed that the setting is made so that the direction in which the brightness changes is reversed.

  The point pen 3 detects the luminance at the timing according to the instruction information sent from the projector 1, and displays the screen from each luminance information obtained by the total four detections of the first to fourth gradation images for each instruction information. The X and Y coordinate positions pointed at are calculated, and the calculated coordinate information is returned to the projector 1.

  The projector 1 can determine the coordinates of the point position of the point pen 3 based on the coordinate information returned from the point pen 3 after a certain delay time.

  Here, the coordinate information of the point position for one point can be acquired for one frame of the color image. Further, the CPU 18 may perform a smoothing process of the frames before and after the acquired frames and coordinates to prevent unnecessary fine vibrations in the image. Then, the CPU 18 projects the point mark PT at the position of the coordinate information obtained by superimposing on the image projection according to the image signal from the input / output unit 11.

  At the same time, the CPU 18 sets γ correction conditions that particularly emphasize the intermediate gradation for each of the R, G, and B pixel gradations in accordance with the γ correction conditions 1-2 stored in the program memory 20 in advance ( Step S117) Assuming that a series of processes related to the setting menu selection operation has been completed, the process returns to step S101 again.

  In this case, the sequence shown in FIG. 10 has a lower frequency of inserting the position detection image and the time is shorter than the sequence shown in FIG. Compared to 1, the method of emphasizing intermediate gradations of R, G, and B pixel gradations is weak.

  Next, a case will be described in which it is determined in step S109 that the user has not manually set the followability of the point mark with respect to the operation of the point pen 3 or the like. In this case, it is determined that the followability of the point mark is in an automatic setting state, and the CPU 18 executes processing according to the automatic setting.

  FIG. 6 is a flowchart of a subroutine showing the detailed contents of the automatic processing executed by the CPU 18 at this time. Here, as a projection mode, “Presentation Mode” that prioritizes brightness over anything, “Standard Mode” that sets the overall brightness and color in a well-balanced manner, and “Theater Mode” that prioritizes the darkness of colors and dark areas. An example in which the following three types can be selected will be described.

Initially, the CPU 18 first determines whether or not the set projection mode is the “presentation mode” (step S201).
If it is determined that the mode is the “presentation mode”, the CPU 18 replaces the R, G, and B fields constituting one frame of the color image with an image based on the image signal from the input / output unit 11 at the end of the field. A sequence for inserting a detection image is selected and set (step S202).

  The processing after step S203, which is the subsequent processing, is the same as that described in step S112 in FIG.

  If it is determined in step S201 that the “presentation mode” is not set, the CPU 18 next determines whether or not the “standard mode” is set (step S204).

  If it is determined that the “standard mode” is set, the CPU 18 performs contrast analysis on the image signal input from the input / output unit 11 at that time (step S205). In response to the analysis result, the CPU 18 uses a two-stage threshold value to determine whether the input image has a high contrast depending on whether the contrast of the input image is higher than the higher threshold value. Is determined (step 206).

  If it is determined that the contrast of the input image is higher than the higher threshold and is high contrast, the CPU 18 proceeds to the process from step S202 and executes the same process as in the “presentation mode”. Let

  If it is determined in step S206 that the input image is not high contrast, the CPU 18 then determines whether the input image contrast is higher than the lower threshold value of the two-stage threshold value. It is determined whether or not the image has medium contrast (medium contrast) (step 207).

  If it is determined that the contrast of the input image is higher than the lower threshold and is medium contrast, the CPU 18 excludes the B field from the R, G, and B fields constituting one frame of the color image. , G, a sequence for inserting a position detection image is selected and set in place of the image based on the image signal from the input / output unit 11 at the end of the field (step S208).

  The subsequent processes after step S209 are the same as those described in step S115 in FIG.

  If it is determined in step S204 that “standard mode” is not set and “theater mode” is set, or in step S207, the contrast of the input image is lower than a lower threshold. The CPU 18 sets a W (white) field in addition to the R, G, and B fields constituting one frame of the color image, and the image based on the image signal from the input / output unit 11 is set in the W field. Instead, the sequence for inserting the position detection image is selected and set (step S210).

  Subsequent processes, step S211 and subsequent processes, are the same as those described in step S117 in FIG.

  In this way, in the automatic setting state, setting corresponding to the point pen usage environment (state) can be performed corresponding to the projection mode and the feature information (contrast) of the projection image set at that time. it can.

  As described above in detail, according to the present embodiment, the frequency of inserting the position detection image of the point pen 3 in one frame of the color image is variable according to the setting. Accordingly, it is possible to set an appropriate operating environment.

  In the present embodiment, for example, in the color field that is disadvantageous in terms of luminance, such as the B field in the R, G, and B fields, the position detection image of the point pen 3 is not intentionally inserted. In addition, the position detection distance of the point pen can be lengthened while suppressing deterioration in image quality.

  In addition, light corresponding to the position detection image in one frame of the color image according to the use environment (state) of the point pen corresponding to the projection mode and the characteristic information (contrast) of the projection image set at that time. By determining the frequency of inserting and projecting an image, it is possible to automatically realize a setting suitable in terms of the balance between the tracking performance and the image quality without bothering the user.

  Further, if the frequency of inserting the position detection image of the point pen 3 is determined by the user's manual setting, the user's intention is reflected and a setting suitable from the viewpoint of the balance between the tracking performance and the image quality is realized. Can do.

  Further, in the above embodiment, the position where the position detection image of the point pen 3 is inserted is set to the end of each color field, but it may be the first half. Thus, the number of times the light source is turned on / off can be reduced and the control can be simplified without increasing the number of color fields.

  In the above-described embodiment, two images with inverted luminance patterns are used as the position detection image of the point pen 3, so that the brightness gradient in the screen is canceled and detected from the inverted image. By calculating the difference between the values, the influence of the ambient light on the luminance sensor of the point pen can be canceled out, so that the detection accuracy of the position coordinates can be improved.

  Similarly, in the above-described embodiment, two images whose luminance pattern change directions are orthogonal to each other are used as the position detection image of the point pen 3, so that accurate detection in each coordinate axis direction can be performed.

  In the above embodiment, the position of the point pen 3 is detected, and the point mark image is superimposed and projected on the corresponding position in the projection image. Therefore, the point pen 3 itself is a light beam such as a laser beam. In spite of not emitting light, it can be controlled as if the pointing position is pointed by the emitted light, and further, a point mark whose color and shape can be arbitrarily changed by setting can be realized.

  In the above-described embodiment, the gamma profile is described as being loaded and set at the beginning of the image frame. However, when the mode is determined, the gamma profile can be loaded and set prior to projection. It may be.

  Further, in the above embodiment, the position detection images are inserted so as to form a set so that there is no luminance unevenness in the screen, and are not related to the gradation reproduction of the input signal. Alternatively, γ correction may not be performed.

  In the above embodiment, the position coordinate is calculated with the point pen 3, but the point pen 3 transmits the luminance information as the information regarding the position, and the projector 1 receives the luminance information that is the information regarding the position. Then, the position coordinates may be calculated.

  In the above embodiment, the example of the contrast of the image signal has been described as the feature information. However, a change or the like as a moving image is analyzed as the feature information, and an appropriate position detection image of the point pen 3 is inserted from the analysis result. It is good also as what determines the frequency to do.

  In the above-described embodiment, the projector 1 has been described as being capable of projecting a color image having light emitting elements of a plurality of colors. However, in a technique that uses a pointer pen as a position specifying device like a laser pointer, a single color is used. It may be a monochrome (single color) projector using a light source.

  Although the projector 1 has been described as adopting the DLP (registered trademark) system, the present invention does not limit the configuration of a light emitting element or the like used in the light source unit.

  In addition, the present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention in the implementation stage. Further, the functions executed in the above-described embodiments may be combined as appropriate as possible. The above-described embodiment includes various stages, and various inventions can be extracted by an appropriate combination of a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the effect is obtained, a configuration from which the constituent requirements are deleted can be extracted as an invention.

Hereinafter, the invention described in the scope of claims of the present application will be appended.
The invention described in claim 1 uses a light source having light emitting elements of a plurality of colors, an input means for inputting an image signal, and light sent from the light source in a time division for each color field, according to the color of the light A projection means for forming and projecting an optical image corresponding to the image signal input by the input means, and an optical image corresponding to a position detection image for detecting a position in the optical image. Projection control means for projecting by means, and information for instructing detection of position coordinates to be transmitted to the point device outside the apparatus at the timing when the projection control means projects the optical image corresponding to the position detection image by the projection means. Transmitting means, receiving means for receiving position coordinate information sent from the point device in response to transmission by the transmitting means, and the projection control means for detecting a position detection image in one color image frame. Characterized by comprising a determination means for determining the frequency of projecting by inserting a corresponding optical image.

  According to a second aspect of the present invention, in the first aspect of the present invention, the determination unit does not insert an optical image corresponding to the position detection image in one color image frame projected by the projection unit. A color field is determined.

  The invention according to claim 3 is the invention according to claim 2, wherein the determination means does not insert an optical image corresponding to the position detection image in one color image frame projected by the projection means. The color field is determined according to the luminance of light from the light source.

  The invention according to claim 4 further comprises selection means for selecting one of a plurality of projection modes in which at least one of color representation and brightness is set, according to the invention according to any one of claims 1 to 3. The determining means determines the frequency according to the projection mode selected by the selecting means.

  According to a fifth aspect of the invention, in the invention according to any one of the first to fourth aspects, the image processing apparatus further comprises a discriminating unit that discriminates the feature information of the image signal. In response, the frequency is determined.

  The invention described in claim 6 further comprises receiving means for receiving a user instruction regarding the frequency in the invention described in any one of claims 1 to 3, wherein the selecting means includes a user's instruction received by the receiving means. The frequency is determined by an instruction.

  According to a seventh aspect of the present invention, in the invention according to any one of the first to sixth aspects, the projection control means converts a light image corresponding to the position detection image into a light corresponding to the image signal in a color field. Projection is performed at successive timings before or after the image projection timing.

  The invention according to claim 8 is the invention according to any one of claims 1 to 5, wherein the light image corresponding to the position detection image has a change in luminance pattern in which time-average luminance is uniform for each position. Is an optical image corresponding to two images that are inverted.

  The invention according to claim 9 is the invention according to any one of claims 1 to 6, wherein the light image corresponding to the position detection image is light corresponding to two sets of images whose luminance pattern change directions are orthogonal to each other. It is an image.

  A tenth aspect of the invention corresponds to the image signal input by the input means, which is projected by the projection means based on the positional information received by the reception means in the invention of any one of the first to seventh aspects. The apparatus further comprises pointer control means for superposing and arranging the optical image corresponding to the pointer image in the optical image.

  The invention according to claim 11 uses a light source having light emitting elements of a plurality of colors, an input unit for inputting an image signal, and light transmitted from the light source in a time division for each color field. A projection method in an apparatus including a projection unit, a transmission unit, and a reception unit that forms and projects an optical image corresponding to an image signal input by an input unit, for detecting a position in the optical image A projection control step in which a light image corresponding to the position detection image is inserted and projected by the projection unit, and a position coordinate is detected at a timing at which the light image corresponding to the position detection image is projected by the projection control step. In the transmission step of transmitting the instructing information to the point device outside the apparatus, the reception step of receiving information on the position coordinates transmitted from the point device in response to the transmission in the transmission step, and the projection control step Color Characterized in that and a determination step of determining how often to insert and projecting a light image corresponding to the position detection image in the image frame.

  The invention described in claim 12 uses a light source having light emitting elements of a plurality of colors, an input unit for inputting an image signal, and light transmitted from the light source in a time-division manner for each color field, and the light source is provided according to the color of light A program executed by a computer built in an apparatus including a projection unit, a transmission unit, and a reception unit that forms and projects an optical image corresponding to an image signal input by an input unit, the computer comprising the optical image Projection control means for inserting a light image corresponding to a position detection image for detecting the position in the image and projecting it by the projection unit, and projecting a light image corresponding to the position detection image by the projection control step Transmitting means for transmitting information instructing detection of position coordinates at timing to a point device outside the apparatus, and receiving information on position coordinates sent from the point device in response to transmission by the transmitting means Receiving means that, and is characterized in that to function as a determining means for determining the frequency of projecting by inserting an optical image corresponding to the position detection image in the color image frame in the projection control means.

  DESCRIPTION OF SYMBOLS 1 ... Projector, 2 ... PC, 3 ... Point pen, 11 ... Input-output part, 12 ... Image conversion part, 13 ... Projection process part, 14 ... Micromirror element, 15 ... Light source part, 16 ... Mirror, 17 ... Projection lens , 18 ... CPU, 19 ... main memory, 20 ... program memory, 21 ... operation unit, 22 ... audio processing unit, 23 ... pointer communication unit, 24 ... speaker unit, 25 ... antenna, 31 ... light receiving lens system, 32 ... Phototransistor 33 ... A / D conversion unit 34 ... demodulation unit 35 ... coordinate calculation unit 36 ... CPU 37 ... main memory 38 ... program memory 39 ... click key unit 40 ... projector communication unit 41 ... Antenna 51 ... CPU 52 ... North bridge 53 ... Main memory 54 ... Graphics accelerator 55 ... Graphic memory 56 ... D Play, 57 ... South bridge, 58 ... PCI-Express slot, 59 ... Keyboard / mouse, 60 ... Hard disk drive (HDD), 61 ... Optical disk drive, 62 ... Network connector, 63 ... USB connector, AGP ... Graphics interface, B ... bus, FSB ... front side bus, MB ... memory bus, PI ... projected image, PT ... point mark, SB ... system bus, VC ... VGA cable, UC ... USB cable.

Claims (12)

A light source having light emitting elements of multiple colors;
An input means for inputting an image signal;
Projecting means for forming and projecting a light image corresponding to an image signal input by the input means according to the color of light using light transmitted in a time-sharing manner from the light source for each color field;
Projection control means for inserting a light image corresponding to a position detection image for detecting a position in the light image and projecting it by the projection means;
Transmitting means for transmitting information instructing detection of position coordinates to a point device outside the apparatus at a timing when the projection control means projects a light image corresponding to the position detection image by the projection means;
Receiving means for receiving information relating to position coordinates sent from the point device in response to transmission by the sending means;
A projection apparatus comprising: a determination unit configured to determine a frequency at which the projection control unit inserts and projects a light image corresponding to a position detection image in one color image frame.   2. The projection apparatus according to claim 1, wherein the determination unit determines at least one color field in which a light image corresponding to the position detection image is not inserted in one frame of a color image projected by the projection unit. .   The determining unit determines at least one color field in which a light image corresponding to the position detection image is not inserted in one color image frame projected by the projecting unit according to the luminance of light from the light source. The projection apparatus according to claim 2. A selection unit that selects one of a plurality of projection modes having different settings of at least one of color representation and luminance;
4. The projection apparatus according to claim 1, wherein the determination unit determines the frequency according to a projection mode selected by the selection unit. A discriminating means for discriminating the feature information of the image signal;
5. The projection apparatus according to claim 1, wherein the determining unit determines the frequency according to a result determined by the determining unit. Further comprising a receiving means for receiving a user instruction regarding the frequency,
The projection apparatus according to claim 1, wherein the selection unit determines the frequency according to a user instruction received by the reception unit.   The projection control means projects the optical image corresponding to the position detection image at a continuous timing before or after the projection timing of the optical image corresponding to the image signal in a color field. Item 7. The projection device according to any one of Items 1 to 6.   The optical image corresponding to the position detection image is an optical image corresponding to two images in which a change in luminance pattern is reversed with uniform temporal average luminance for each position. The projection device according to any one of 1 to 5.   The projection apparatus according to claim 1, wherein the optical image corresponding to the position detection image is an optical image corresponding to two sets of images whose luminance pattern change directions are orthogonal to each other.   Pointer control means for superimposing an optical image corresponding to the pointer image on an optical image corresponding to the image signal input by the input means and projected by the projection means based on the positional information received by the receiving means. The projection apparatus according to claim 1, further comprising: A light source having light emitting elements of a plurality of colors, an input unit for inputting an image signal, light transmitted in a time-sharing manner for each color field from the light source, and an image signal input at the input unit according to the color of light A projection method in an apparatus including a projection unit, a transmission unit, and a reception unit that form and project a corresponding optical image,
A projection control step of inserting a light image corresponding to a position detection image for detecting a position in the light image and projecting it by the projection unit;
A transmission step of transmitting information instructing detection of position coordinates to a point device outside the apparatus at a timing at which a light image corresponding to the position detection image is projected by the projection control step;
A receiving step of receiving information on the position coordinates sent from the point device in response to the transmission in the transmitting step;
And a determination step of determining a frequency of inserting and projecting a light image corresponding to the position detection image in one frame of the color image in the projection control step. A light source having light emitting elements of a plurality of colors, an input unit for inputting an image signal, light transmitted in a time-sharing manner for each color field from the light source, and an image signal input at the input unit according to the color of light A program executed by a computer built in an apparatus including a projection unit, a transmission unit, and a reception unit that form and project a corresponding optical image,
The computer
Projection control means for inserting a light image corresponding to a position detection image for detecting a position in the light image and projecting it by the projection unit;
Transmitting means for transmitting information instructing detection of position coordinates to a point device outside the apparatus at a timing at which a light image corresponding to the position detection image is projected by the projection control step;
A receiving unit that receives information on position coordinates transmitted from the point device in response to transmission by the transmitting unit; and a light image corresponding to the position detection image in one color image frame in the projection control unit. A program that functions as a determination unit that determines the frequency of insertion and projection.

Images