Classifications

• • G—PHYSICS
  • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
  • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
  • G03B21/00—Projectors or projection-type viewers; Accessories therefor
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
• • G—PHYSICS
  • G06—COMPUTING OR CALCULATING; COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
  • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
  • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
  • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
• • G—PHYSICS
  • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
  • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
  • G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
  • G09G3/001—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/12—Picture reproducers
  • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
  • H04N9/3179—Video signal processing therefor
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/12—Picture reproducers
  • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
  • H04N9/3191—Testing thereof
  • H04N9/3194—Testing thereof including sensor feedback
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/12—Picture reproducers
  • H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
  • H04N9/3197—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using light modulating optical valves

Definitions

• FIGS. 5A to 5D are diagrams schematically illustrating in-use states of the image projection apparatus according to the first embodiment of the present invention.
• the projected image eliminating unit 104 receives projector characteristic information from the projection unit 102 as well as controls the projection unit 102 and the camera unit 103 depending on the result of the comparison between the projected image and the sensed image, again in order to improve the accuracy of elimination of the projected image.
• projector characteristic information for example, color temperature information or the like as an example of the projector characteristic information can be used to exercise white balance control over the camera. These types of control will be described.
• FIG. 2 is a block diagram illustrating a configuration example of the projected image eliminating unit 104 in the image projection apparatus 100 in the present embodiment.
• An input image being projected by the projection unit 102 (an output from the GUI overlay unit 113) is input from a terminal 201, whereas an image being sensed by the camera unit 103 (a camera sensed image) is input from a terminal 202.
• An input image correction unit 205 corrects input image signals, based on:
• a sensed image correction unit 206 corrects sensed image signals, based on:
• the sensed image with the projected image eliminated is input from the projected image eliminating unit 104 to a terminal 401.
• the sensed image with the projected image eliminated is written in a memory 403 via a switch 407 in a closed state.
• the memory 403 is configured to be able to store sensed images, and configured to hold previous sensed images supplied to the difference circuit 402 until a significant region determination unit 405 completes determination.
• a difference circuit 402 a difference image is obtained between the input sensed image with the projected image eliminated and a previous sensed image with a projected image eliminated that is delayed by a predetermined period of time by the memory 403. Then, the difference is supplied to a threshold value processing unit 404.
• FIG. 9 shows an example of the effective region of the moving object region detection unit 105.
• a region A 901 is a region adjacent to a periphery of the image, and is considered as a region that is likely to be contained in a sensed region due to camera shake to cause false detection of moving objects particularly in a case in which the image projection apparatus 100 is held by hand.
• the threshold value for determining a closed region as a significant region can be made higher than the threshold value applied to a region B 902 other than the peripheral portion of the image.
• the closed region may be detected from only the region B 902.
• the GUI overlay unit 113 superimposes an operation GUI image prepared in advance onto an image projected from the projection unit 102, depending on the display position and GUI image from the overlay GUI control unit 111, and supplies to the projection unit 102 the operation GUI image superimposed onto the image projected from the projection unit 102. This results in the operation GUI image overlay being displayed (superimposed) on the projected image.
• the operation GUI can be displayed when a region of a user's hand is detected by the moving object region detection unit 105 as a significant region and the position of a fingertip is detected by the hot spot position detection unit 106 as a hot spot position.
• the hot spot movement detection unit 107 compares the hot spot position detected by the hot spot position detection unit 106 with previous position history stored in the hot spot position memory 108 to detect movements of the hot spot.
• the hot spot movement detection unit 107 outputs information relating to the detected movements of the hot spot (for example, information indicating types of movements (such as circular motion and linear motion) ) to the command decode unit 109.
• the system control unit 110 controls components which are not shown in the figure, and carries out processing in accordance with the device control command. For example, if the device control command is a command for switching the projected image, image data to be displayed next is read from a storage device that is not shown in the figure and supplied via the terminal 101 to the overlay unit 113. [0071] As examples of the operation determined by the command decode unit 109, the following is conceivable.
• an image projection apparatus 1000 in the present embodiment is characterized in that a particular shape region detection unit 1014 and a particular shape memory 1015 are provided instead of the moving object region detection unit 105.
• a particular shape region detection unit 1014 and a particular shape memory 1015 are provided instead of the moving object region detection unit 105.
• FIG. 11 is a block diagram illustrating a configuration example of the particular shape region detection unit 1014 in the image projection apparatus 1000 in the present embodiment.
• the sensed image with the projected image eliminated is input to a terminal 1101 from the projected image elimination unit 104.
• a spatial filter unit 1102 predetermined smoothing is carried out for eliminating random noise components.
• a shape detection unit 1103 detects, based on the shape feature quantity information obtained via a terminal 1104 from the particular shape memory 1015, a particular shape region in the sensed image with the projected image eliminated, and outputs from a terminal 1105 information for specifying the detected particular shape region.
• the particular shape region is detected, and it is thus unlikely that a pattern or the like existing on the projection surface will be falsely detected. Therefore, it is not necessary to obtain the difference between two sensed images with projected images eliminated as in the first embodiment .
• an input image 601 that is, a projected image is a face mark, and there is a star pattern on a projection surface to serve as a background. Therefore, the face mark and the star pattern are both contained in a sensed image 602.
• the input image 601 contains an image of the operation GUI.
• the example of FIG. 12 differs from the example of FIG.
• a hot spot movement detection unit 107 detects movements of the hot spot, from temporal variations of the hot spot position 607 detected in S13.
• a command decode unit 109 specifies, in a case in which the operation GUI 609 is displayed, the display position of an operation GUI 609 and an operation instructed by the user from the movement of the hot spot detected in S14 and the position of the hot spot, and outputs a corresponding device operation command .
• an image projection apparatus 1300 in the present embodiment includes both a moving object region detection unit 105, and a particular shape region detection unit 1014 and a particular shape memory 1015, and is characterized in that moving object region detection as in the first embodiment and particular shape region detection as in the second embodiment are used adaptively and selectively in accordance with control exercised by a detection control unit 1317.
• moving object region detection as in the first embodiment and particular shape region detection as in the second embodiment are used adaptively and selectively in accordance with control exercised by a detection control unit 1317.
• the moving object region detection unit 105 detects a significant region regarded as a moving object, from a sensed image with a projected image eliminated, which is output from a projected image elimination unit 104.
• the configuration of the moving object region detection unit 105 is as described in the first embodiment with reference to FIG. 3, in a case in which the significant region is detected in the present embodiment, the shape feature quantity as information for specifying the significant region is stored in a particular shape memory 1015 in accordance with control exercised by the detection control unit 1317.
• the detection control unit 1317 switches a switch 1316 in accordance with the detection result from the moving object region detection unit 105 and the detection result from the particular shape region detection unit 1014, and selects region information to be supplied to a hot spot position detection unit 106. [0109] More specifically, the detection control unit 1317 switches the switch 1316 such that the output from the moving object region detection unit 105 is selected when the region of the operation object is not detected, as shown in FIG. 5B. Further, the detection control unit 1317 switches the switch 1316 such that the output from the particular shape region detection unit 1014 is selected when the region of the operation object is detected, as shown in FIG. 5C. In addition, in this case, the detection control unit 1317 instructs the moving object region detection unit 105 to write the shape feature quantity of the detected moving object region (significant region) in the particular shape memory 1015.
• the command decode unit 109 may determine a user operation without the use of position information on the operation GUI.
• the particular movement itself of the hot spot may be determined as a command.
• the circular motion of the hot spot can be determined as a display command for the operation GUI.
• the standing-still can be regarded as "the particular movement of the hot spot" herein, that is, determined as a user operation.
• the user can gesture to operate the image projection apparatus.
• the image of the operation GUI does not interfere with seeing an input image.
• the user may gesture in any location on the projected image, not in a particular region of the operation GUI, which thus has the advantage of a high degree of freedom in operation.
• the determination of a user operation with the use of the operation GUI and the operation of a user operation based on only position information on the hot spot can be executed in combination.
• the determination of a user operation based on only position information on the hot spot can be executed for an operation for displaying the operation GUI
• the determination of a user operation based on both the display position of the operation GUI and position information on the hot spot can be carried out after displaying the operation GUI.
• no camera unit has to be provided as long as a sensed image of a projection surface containing a projected image can be obtained.

Landscapes

• Engineering & Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• Multimedia (AREA)
• Theoretical Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Physics & Mathematics (AREA)
• Signal Processing (AREA)
• Human Computer Interaction (AREA)
• Computer Hardware Design (AREA)
• User Interface Of Digital Computer (AREA)
• Projection Apparatus (AREA)
• Controls And Circuits For Display Device (AREA)
• Position Input By Displaying (AREA)
• Transforming Electric Information Into Light Information (AREA)

Priority Applications (3)

Applications Claiming Priority (2)

Publications (1)

Family

ID=40428778

Family Applications (1)

Country Status (6)

Cited By (3)

Families Citing this family (45)

Citations (4)

Family Cites Families (14)

• 2007
  • 2007-09-04 JP JP2007229456A patent/JP4829855B2/ja not_active Expired - Fee Related
• 2008
  • 2008-08-22 WO PCT/JP2008/065469 patent/WO2009031457A1/en not_active Ceased
  • 2008-08-22 KR KR1020097014401A patent/KR20090087960A/ko not_active Ceased
  • 2008-08-22 US US12/447,920 patent/US8118433B2/en not_active Expired - Fee Related
  • 2008-08-22 CN CN2008800184686A patent/CN101681217B/zh not_active Expired - Fee Related
  • 2008-08-22 EP EP08792795.0A patent/EP2191350B1/en not_active Not-in-force

Patent Citations (4)

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events