JP2011043876A - Image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device allowing a user to operate a projection image by a simple operation method. <P>SOLUTION: The image display device includes: a projection means 20 for projecting an image to a projection object region 999; an image pickup means 30 for picking up the image of the projection object region 999, and for generating pickup image data; an infrared emission device 150 mounted on the finger of the user; a light spot information generation means for specifying the position of a light spot 950 emitted by the infrared emission device 150 on the projection object region 999 from the pickup image data, and for generating light spot position information; and an image operation means for analyzing the movement of the hand of the user on the projection object region 999 based on the light spot position information, and for moving an image 501 projected to the projection object region 999. Thus, it is possible for the user to operate the image 501 projected to the projection object region 999 by a simple operation to move the finger on which the infrared emission device 150 has been mounted on the projection object region 999. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image display device that allows a user to easily operate an image projected on a projection area.

  In recent years, in meetings, it has been increasing that materials are displayed large on an image display device such as a projector. If the attendee of the meeting can operate the projection image with a simple operation method, the meeting proceeds smoothly.

  On the other hand, as shown in Patent Document 1, a user irradiates a light beam emitted from a light gun to an image projected on a projection area, recognizes the position of the light beam on the projection area, and A virtual space generation device that reflects the progress has been proposed. However, such a virtual space generation device requires a user to perform an operation such as holding a crossing gun and pulling a trigger, and applying this technique to an image display device imposes a complicated operation on the user. It will be.

JP 2000-172445 A

  An object of the present invention is to provide an image display apparatus that can solve the above-described problems and can operate a projection image with a simple operation method.

The invention according to claim 1, which has been made to solve the above-described problem, includes a projecting unit that projects an image on a projection area,
Imaging means for imaging the projection area and generating captured image data;
Light-emitting means worn on the user's hand;
A light spot information generating means for specifying a position on the projection area of the light emitted by the light emitting means from the captured image data, and generating light spot position information;
Storage means for storing light spot position information generated by the light spot information generating means;
Image operation means for analyzing the movement of the user's hand on the projection area based on the light spot position information stored in the storage means and generating an image operation command for operating the image projected on the projection area; ,
It is characterized by having.

  The invention according to claim 2 is characterized in that, in the invention according to claim 1, an image operation command is generated when the intensity of light detected from the captured image data is equal to or greater than a predetermined value.

Invention of Claim 3 exists in the area | region of the image which a projection means projects in invention of Claim 2, and when the intensity | strength of the said light is more than predetermined value,
The image operation means generates an image operation command for changing an image state according to the movement of the position of the light.

According to a fourth aspect of the present invention, in the third aspect of the present invention, the position of the light detected from the captured image data is within the area of the image projected by the projection means, and the intensity of the light is predetermined. If the value is greater than or equal to
The image operation means generates an image operation command for moving an image with the movement of the position of the light.

The invention according to claim 5 is the invention according to claims 1 to 4, wherein the light emitting means is provided so as to irradiate the projection area with light,
The imaging means images reflected light reflected by the projection area by the light emitted by the light emitting means,
The light spot information generating means recognizes the reflected light imaged by the imaging means as a light spot and generates light spot position information.

  The invention described in claim 6 is characterized in that, in the invention described in claim 5, the light emitting means is mounted on the fingertip and emits divergent light in the fingertip direction.

  A seventh aspect of the invention is characterized in that, in the inventions of the first to sixth aspects, the projection means is arranged to face the projection area.

  The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein the light emitting means emits infrared rays, and the imaging means is an infrared camera that images the infrared rays emitted by the light emitting means. And

The invention according to claim 1 is a projecting unit that projects an image on a projection area, an imaging unit that captures the projection area and generates captured image data, and a light emitting unit that is worn on a user's hand; The light spot information generating means for specifying the position on the projection area of the light emitted by the light emitting means from the captured image data and generating the light spot position information, and the light generated by the light spot information generating means Based on the storage means for storing the point position information and the light spot position information stored in the storage means, the movement of the user's hand on the projection area is analyzed, and the image projected on the projection area is operated. And image operation means for generating an image operation command to be performed.
Accordingly, the user can operate the image projected on the projection area by a simple operation of moving the hand on which the light emitting unit is mounted on the projection area.

The invention described in claim 2 is characterized in that, in the invention described in claim 1, an image operation command is generated when the intensity of light detected from captured image data is equal to or greater than a predetermined value.
As a result, when the intensity of the light spot is smaller than the predetermined value, an image operation command is not generated, so that it is possible to prevent an erroneous operation of the image.

Invention of Claim 3 exists in the area | region of the image which a projection means projects in invention of Claim 2, and when the intensity | strength of the said light is more than predetermined value,
The image operation means generates an image operation command for changing an image state according to the movement of the position of the light.
As a result, only the image pointed to by the user is the target of the operation, the image operated by the user can be easily recognized, and an intuitive operational feeling can be provided.

According to a fourth aspect of the present invention, in the third aspect of the present invention, the position of the light detected from the captured image data is within the area of the image projected by the projection means, and the intensity of the light is predetermined. When the value is equal to or greater than the value, the image operation means generates an image operation command for moving the image as the position of the light moves.
Accordingly, the user simply places the hand on which the light emitting means is mounted on the image projected on the projection area and moves the hand with the light intensity being equal to or higher than a predetermined value. The image projected on the area can be moved, and the image can be moved by an easy operation.

According to a fifth aspect of the present invention, in the first to fourth aspects of the present invention, the light emitting means is provided so as to irradiate the projection area with light, and the imaging means emits light by the light emitting means. The reflected light reflected by the projected area is imaged, and the light spot information generating means recognizes the reflected light imaged by the imaging means as a light spot and generates light spot position information. And
As a result, when the user removes the hand on which the light emitting means is attached from the projection area, the light emitted from the light emitting means is attenuated and reflected to the projection area, so the user releases the hand from the projection area. This can be detected with high accuracy, and erroneous operation of the image can be eliminated.

The invention described in claim 6 is characterized in that, in the invention described in claim 5, the light emitting means is mounted on the fingertip and emits divergent light in the fingertip direction.
As a result, when the finger is moved away from the projection area, the light intensity of the projection area rapidly decreases, so that it is reliably detected that the user's finger is separated from the projection area, and is separated from the projection area. It is possible to eliminate a malfunction when the user moves the finger at the position. For this reason, the image can be manipulated only when the projection area is touched with a finger, and it is possible to give the user the feeling of operating the image projected on the projection area with the finger. .

A seventh aspect of the invention is characterized in that, in the inventions of the first to fifth aspects, the projection means is arranged to face the projection area.
As a result, it is possible to use a normal desk or wall as the projection area without using a special screen as the projection area.

The invention according to claim 8 is the invention according to any one of claims 1 to 7, wherein the light emitting means emits infrared rays, and the imaging means is an infrared camera that images the infrared rays emitted by the light emitting means. And
As a result, noise caused by visible light can be eliminated and the movement of the user's hand can be accurately detected.

1 is a schematic diagram of an image display device according to an embodiment of the present invention. It is explanatory drawing of an infrared rays light-emitting device. It is explanatory drawing of the movement operation state of an image. It is a block diagram of an image display apparatus. It is a flowchart of the main process of an image display apparatus. It is explanatory drawing of light spot position information. It is explanatory drawing of the expansion operation state of an image.

(Outline of the image display device of the present invention)
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. As shown in FIG. 1, the image display device 100 of the present invention includes a control unit 10, a projection unit 20, an imaging unit 30, and an infrared light emitting device 150.
In the present embodiment, the projection unit 20 and the imaging unit 30 are arranged to face a projection area 999 such as a plate surface of a table. The projection unit 20 is a device that projects a single image or a plurality of images 501 onto the projection area 999 based on the “image signal” output from the control unit 10. The imaging unit 30 is a device that images the projection area 999. Note that an infrared light emitting device 150 that irradiates the projection area 999 with infrared rays is attached to the user's finger. The imaging means 30 images the light spot 950 (reflected light) irradiated to the projection area 999 by the infrared light emitting device 150. The control unit 10 identifies the position of the light spot 950 captured by the imaging unit 30 on the projection area 999, recognizes the movement of the user's finger based on the position information of the light spot 950, and moves the image 501. Device.

  As shown in FIG. 2, the infrared light emitting device 150 includes a power supply unit 150a, an infrared light emitting unit 150b, and a mounting unit 150c. The power supply unit 150a houses a primary battery and a secondary battery, and supplies current supplied from these batteries to the infrared light emitting unit 150b. The infrared light emitting unit 150b emits infrared light by the current supplied from the power supply unit 150a. In the present embodiment, the infrared light emitting unit 150b is an infrared LED. As shown in FIG. 2, the infrared light emitted from the infrared light emitting unit 150b diffuses at a predetermined angle θ. The mounting portion 150c has a ring shape and is mounted on the user's finger. As shown in FIG. 2, the infrared light emitting unit 150b radiates and emits infrared light in the fingertip direction.

  In the present invention, as shown in FIG. 3, a drag operation and a drop operation can be performed on an image 501 projected on the projection area 999. Specifically, the user places the finger with the infrared light emitting device 150 on the image 501 projected on the projection area 999 and maintains the state where the finger is placed on the projection area 999. When the finger is moved to a target location (drag operation), the image 501 moves as the finger moves. On the other hand, when the user releases the finger from the projection area 999 at a target location (drop operation), the image 501 is displayed at a position where the user releases the finger. As described above, the image display apparatus 100 according to the present invention enables the user to perform a so-called “drag and drop operation” on the image 501 projected on the projection area 999. Note that the infrared light emitting device 150 can be attached to the fingers of a plurality of users, and the plurality of users can operate a single image or a plurality of images 501.

  In the present invention, the imaging means 30 captures the infrared ray (light spot 950) reflected by the projection area 999, and the control unit 10 specifies the position of the light spot 950 on the projection area 999 to obtain “light spot position information”. , And the movement of the image 501 projected by the projection unit 20 is moved by recognizing the movement of the user's finger based on the change in the “light spot position information”, thereby realizing the “drag operation”. ing. As described above, the infrared light emitted from the infrared light emitting device 150 is diffused at a predetermined angle θ. For this reason, when the user removes his / her finger from the projection area 999, the intensity of the infrared ray (light spot 950) reflected by the projection area 999 becomes weak. Is recognized, the user's finger is separated from the projection area 999, and the “drop operation” is recognized. Below, the specific structure of the image display apparatus 100 of this invention is demonstrated.

(Block diagram of image display device)
Hereinafter, a block diagram of the image display apparatus 100 will be described with reference to FIG. The control unit 10 includes a CPU 11, a RAM 12, a ROM 13, a captured image controller 15, a projection image controller 17, a VRAM 18, and an input unit 19, which are connected to each other via a bus 9. The projection image controller 17 and the VRAM 18 are connected to each other.

The CPU 11 performs various calculations and processes in cooperation with the RAM 12 and the ROM 13.
The RAM 12 temporarily stores a program processed by the CPU 11 and data processed by the CPU 11 in its address space. The RAM 12 includes an image data storage area 12a, a captured image data storage area 12b, a light spot information storage area 12c, and an image operation command storage area 12d.
As will be described later, “image data” acquired by the input unit 19 is stored in the image data storage area 12a.
In the captured image data storage area 12b, “captured image data” captured by the imaging unit 30 and generated by the captured image controller 15 is stored.
In the light spot information storage area 12c, “light spot position information” generated by the light spot information generating means 13b is stored.
The image operation command storage area 12d stores “image operation commands” generated by the image operation means 13c.

  Various programs for controlling the image display device 100 are stored in the ROM 13. The ROM 13 stores programs such as a projection image generation unit 13a, a light spot information generation unit 13b, and an image operation unit 13c. The various programs are processed by the CPU 11, thereby realizing various functions of the image display device 100. It should be noted that the program may be realized as an ASIC (Application Specific Integrated Circuit).

  The projection image generation unit 13 a is a program that outputs a “drawing command” to the projection image controller 17 and causes the projection image controller 17 to generate “projection image data” from “image data”.

  The light spot information generation means 13b specifies the position on the projection area 999 of the light spot 950 emitted by the infrared light emitting device 150 from the “captured image data” captured by the imaging means 30, and “light spot position information”. Is a program that generates

  The image operation means 13c analyzes the movement of the user's hand (finger) on the projection area 999 based on the “light spot position information”, and operates the image 501 projected on the projection area 999. It is a program that generates a “command”.

The captured image controller 15 includes an A / D converter and a DSP (Digital Signal Processor). The A / D converter converts a “signal voltage” output from an image sensor of the imaging unit 30 described later into a “digital signal”.
The DSP generates “captured image data” that is two-dimensional pixel data from the “digital signal” generated by the A / D converter. The generated “captured image data” is stored in the captured image data storage area 12b.
Each pixel of the “captured image data” has “pixel position information” that is position information on the projection area 999 and “infrared intensity information” that is information on the intensity (luminance) of infrared rays. ing.

The projection image controller 17 has an image processing circuit such as a GPU (Graphics Processing Unit). The projection image controller 17 performs image processing on the “image data” stored in the image data storage area 12 a based on the “drawing command” output from the projection image generation unit 13 a to generate “projection image data”. To do.
The VRAM 18 stores “projection image data” generated by the projection image controller 17.
The projection image controller 17 outputs “projection image data” stored in the VRAM 18 as an “image signal” to the projection means 20.

  The input unit 19 acquires “image data”. The input unit 19 includes an interface such as a LAN (abbreviation of Local Area Network) and USB (abbreviation of Universal Serial Bus), a media reader that reads media such as an SD memory card, and the like. When a personal computer, a USB memory, or the like in which “image data” is stored is connected to the input unit 19, the input unit 19 acquires the “image data”, and the “image data” is stored in the image data storage area 12 a of the RAM 12. To come to remember. Alternatively, when the input unit 19 is connected to a LAN or the Internet, the input unit 19 acquires “image data” via the LAN or the Internet. An auxiliary storage device such as a hard disk or a flash memory may be connected to the bus 9 and the “image data” acquired by the input unit 19 may be stored in the auxiliary storage device. The “image data” acquired by the input unit 19 includes image files such as photographs, and image files such as spreadsheet software, word processor software, and presentation software.

  The projection unit 20 includes a lamp driving circuit, a lamp, an illumination optical system, an image generation element, and an imaging optical system. The lamp driving circuit is a circuit that supplies current to the lamp. The lamp supplied with current from the lamp driving circuit emits diffused light. The illumination optical system collects the diffused light emitted from the lamp and makes it uniform illumination light. This illumination light is applied to the image generating element. The image generation element is an LCD (Liquid Crystal Display) or a DMD (Digital Micromirror Device), and generates an image by expressing the irradiated illumination light in gradation on each pixel. The imaging optical system is composed of a large number of lenses, and images the illumination light that has passed through the image generating element on the projection area 999. Of course, the wavelength of the illumination light is in the visible light region.

The imaging unit 30 is a device that images the projection area 999. The imaging device 30 has an image sensor and an imaging optical system. The image sensor has photodiodes arranged two-dimensionally. Each photodiode converts the intensity of incident light into an electric charge, and outputs the electric charge as a “signal voltage”. The image sensor includes a charge coupled device image sensor (CCD) and a complementary metal oxide semiconductor (CMOS). The imaging optical system is composed of a single lens or a plurality of lenses, and forms an incident image on an image sensor. In the present embodiment, the image sensor can convert light from the visible light to the near-infrared wavelength (wavelength of 0.3 to 1.0 μm) into electric charges, and the imaging means 30 further includes an infrared cut filter. In other words, it is a so-called infrared camera capable of capturing an image using visible light and infrared light. In addition, in order to remove noise caused by visible light, light having an infrared wavelength (wavelength of 0.8 to 1.0 μm) is transmitted and light having a wavelength of visible light (wavelength of 0.3 to 0.8 μm) is transmitted. It is preferable to provide a visible light cut filter for blocking in front of the image sensor.
Note that an image sensor using HgCdTe (mercury cadmium tellurium), InSb (indium antimony), or PtSi (platinum silicon) may be used in order to reliably detect near infrared rays. In this case, the wavelength of infrared rays emitted from the infrared light emitting unit 150b is preferably 1.0 μm or more.

(Description of flow)
Below, the flow of the main process of this invention is demonstrated. When the image display apparatus 100 is powered on, the process proceeds to S11 “initialization”.
In the process of S11 “initialization”, various programs stored in the ROM 13 are activated. When the process of S11 ends, the process proceeds to S12.

In the process of S <b> 12 “projection”, the projection image generation unit 13 a outputs a “drawing command” to the projection image controller 17. Based on the “drawing command”, the projection image controller 17 generates “projection image data” from the “image data” stored in the image data storage area 12 a and stores it in the VRAM 18. The projection image controller 17 outputs “projection image data” stored in the VRAM 18 as an “image signal” to the projection unit 20, and the projection unit 20 projects the image 501 onto the projection area 999. The “drawing command” includes a command for designating an area position on the projection area 999 on which the image 501 is projected. Further, the projection image controller 17 can generate “projection image data” for projecting a plurality of images 501 onto the projection area 999 by a “drawing command” output from the projection image generation unit 13 a.
As will be described later, the projection image generation unit 13a refers to the image operation command storage area 12d when outputting the “drawing command” to the projection image controller 17, and the “image movement command” is stored in the storage area. If an “image move command” is stored, a “draw command” for moving the image 501 projected on the projection area 999 is issued based on the “image move command”. Output to the projection image controller 17.
When the process of S12 is completed, the process proceeds to S13 “Imaging”.

In the process of S <b> 13 “imaging”, the light spot information generation unit 13 b outputs an “imaging command” to the captured image controller 15 and starts imaging of the projection area 999 by the imaging unit 30. “Captured image data” captured by the imaging unit 30 and generated by the captured image controller 15 is stored in the captured image data storage area 12b. Generally, the frame rate recognized as a smooth moving image for human beings is set to 20 to 25 frames / second. Accordingly, in the present embodiment, the processing of S12 to S18, S19, S20 or S12 to S25 is executed in 40 to 50 milliseconds, and the main processing loops once, so that an “imaging command” is performed every 40 to 50 milliseconds. Is output and “captured image data” is generated.
When the process of S13 is completed, the process proceeds to S14.

In the process of S14 “light spot detection”, the light spot information generation unit 13b executes “light spot detection process” of detecting a light spot from “captured image data” stored in the captured image data storage area 12b. Specifically, the light spot information generating unit 13b analyzes “infrared intensity information”, which is information on the intensity (luminance) of infrared rays, for each pixel of the “captured image data”, and determines the intensity of infrared rays equal to or greater than a predetermined value. A set of pixels is detected as a light spot 950.
Note that when the user places a finger with the infrared light emitting device 150 on the projection area 999, the distance between the infrared LED 150b and the projection area 999 is close. Therefore, since the infrared light emitted from the infrared LED 150b is reflected by the projection area 999 without being greatly attenuated, the infrared light reflected by the projection area 999 has an intensity higher than a predetermined value, and the light spot 950 is detected. On the other hand, when the user removes the finger on which the infrared light emitting device 150 is attached from the projection area 999, the distance between the infrared LED 150b and the projection area 999 is increased. Therefore, the infrared light emitted from the infrared LED 150b is greatly attenuated and reflected by the projection region 999. The infrared light reflected by the projection region 999 has an intensity smaller than a predetermined value, and the light spot 950 is not detected. In other words, the predetermined value of the intensity of infrared rays that serves as a reference for detecting the light spot 950 is equal to or greater than the predetermined value when the user's finger with the infrared light emitting device 150 is placed on the projection area 999. It is set to be less than a predetermined value when it is not placed.
In addition, when a plurality of users place a finger on which the infrared light emitting device 150 is mounted on the projection area 999, a plurality of light spots 950 are detected.
When the processing of S14 is completed, the process proceeds to S15 “Is there a light spot?”

In the determination process of S15 “Is there a light spot?”, The light spot information generating unit 13b determines whether or not the light spot 950 has been detected in the process of S14.
If the light spot information generating unit 13b determines that the light spot 950 has been detected in the process of S14 (YES in S15), the process proceeds to S16.
On the other hand, the light spot information generating means 13b? However, when it is determined that the light spot 950 has not been detected in the process of S14 (NO in S15), the process proceeds to the determination process of S25.

  In the determination process of S25 “End?”, When the user selects to end the image display device 100 by operating an operation unit (not shown) (YES in S25), the process is shown in FIG. The main flow ends. On the other hand, when the user does not select to end the image display apparatus 100 (NO in S25), the process proceeds to S12.

In the processing of S16 “light spot position information storage”, the light spot information generation means 13b generates “light spot position information” which is position information on the projection area 999 of the light spot 950, and the light spot information storage area 12c. The “light spot position information” is coordinate data from a specific point (0, 0) (shown in FIG. 1) on the projection area 999 (represented by two-dimensional numerical values of X and Y). . Since “light spot position information” is generated after a predetermined time, “light spot position information” is sequentially stored in the light spot information storage area 12c as a history of “light spot position coordinates” as shown in FIG. The When a plurality of light spots 950 are detected in the process of S14, as shown in FIG. 6, “light spot position information” of the plurality of light spots 950 is stored in the light spot information storage area 12c. .
In this embodiment, the light spot information generating unit 13 generates “light spot position information” using the center of gravity of the set of pixels detected as the light spot 950 as the position on the projection area 999 of the light spot 950. To do. When the process of S16 ends, the process proceeds to S17.

In the processing of S <b> 17 “light spot position difference calculation”, the image operation means 13 c refers to the light spot information storage area 12 c and stores the “light spot position information” stored this time and the “light spot position information” stored last time. The difference value is calculated. In the example shown in FIG. 6, “light spot position information” is calculated with the difference between 1600 ms and 1650 ms as follows.
dX = 811-818 = 1 [mm], dY = 341-342 = −1 [mm]
When the process of S17 ends, the process proceeds to the determination process of S18.

In the determination processing of S18 “projection image coincides with light spot position”, the image operation means 13c determines whether or not the light spot 950 is present on the image 501 projected on the projection area 999. Specifically, the image operation means 13c refers to the latest “light spot position information” stored in the light spot information storage area 12b, so that the coordinates of the light spot 950 on the projection area 999 are changed. It is determined whether or not it is within the coordinate range of the area of the projection image 501 projected on the projection area 999. Since the distance between the projection unit 20 and the projection region 999 is constant, the image operation unit 13c recognizes the coordinates of the region of the image 501 on the projection region 999.
When the image operation means 13c determines that the light spot 950 is present on the image 501 projected on the projection area 999 (YES in S18), the process proceeds to S19.
On the other hand, when the image operation means 13c determines that there is no light spot 950 on the image 501 projected on the projection area 999 (NO in S18), the process returns to S12.

In the determination processing of S19 “Is the light spot moved?”, The image operation means 13c determines whether or not the light spot 950 has moved.
Specifically, when the image operation unit 13c determines that the difference value calculated in the process of S17 is not 0 in at least one of X and Y, the image operation unit 13c moves the light spot 950. (Yes in S19), the process proceeds to S20.
On the other hand, when the image operation unit 13c determines that the difference value calculated in the process of S17 is 0 in both X and Y, the image operation unit 13c does not move the light spot 950. (The determination process in S19 is NO), the process proceeds to S12.
If the difference value calculated in the process of S17 is equal to or greater than a predetermined value, it is not the movement of the finger of the same user, but “light spot position information” of another user and “light spot position information” of another user. It returns to the process of S12, without proceeding to the process of S20.

  In S20 “projected image moving process”, the image operation means 13c executes “projected image moving process”. Specifically, the image operation means 13c moves the image 501 projected on the projection area 999 by the coordinates corresponding to the difference value of the “light spot position information” calculated in the process of S17. Command "is generated and stored in the image operation command storage area 12d. When the process of S20 ends, the process returns to S12.

When the “projection image movement command” is stored in the image operation command storage area 12d, the projection image generation unit 13a performs the projection area based on the “projection image movement command” in the process of S12. A “drawing command” for moving the image 501 projected on 999 is output to the projection image controller 17. For this reason, the image 501 moves with the movement of the position of the light spot 950.
Note that, when the user removes the finger on which the infrared light emitting device 150 is attached from the projection area 999, as described above, the infrared light is attenuated and irradiated to the projection area 999. Is detected, the above-described “drop operation” is detected (NO in S15, and the process proceeds to S25), and the user moves his / her finger without moving the image 501 projected on the projection area 999. The image 501 is displayed at the separated position.

As described above, in the image display device 100 of the present invention, the user simply places the finger on which the infrared light emitting device 150 is mounted on the image 501 displayed in the projection area 999 and moves the finger. Thus, it is possible to perform a “drag and drop operation” for moving the image 501, and it is possible to move the projection image 501 projected on the projection area 999 by a simple operation method.
In the present embodiment, the projection area 999 is imaged by the imaging means 30 that is an infrared camera, the reflected light from the infrared projection area 999 is recognized as the light spot 950, and the user is based on the position information of the light spot 950. Therefore, even if the light spot 950, which is infrared light, is superimposed on the image 501 that is visible light projected on the projection area 999, the wavelength of visible light is different from that of infrared light. Therefore, the light spot 950 can be reliably detected, and the movement of the user's finger can be reliably detected.

(Summary)
In the present embodiment, the projection unit 20 is arranged to face the projection area 999. However, the projection area 999 is formed of a translucent screen, and the so-called rear projection in which the projection unit 20 is arranged behind the screen. The present invention may be configured as an image display device of the type. Further, when the projection area 999 is a translucent screen, the imaging means 30 may be disposed behind the screen to capture the screen.

  In the above description, the embodiment in which the user moves the image 501 projected on the projection area 999 has been described. However, as illustrated in FIG. 7, the corner of the image 501 is “dragged and dropped”, or Needless to say, the technical idea of the present invention can also be applied to an image display apparatus that enlarges the image 501 by multi-touching diagonal lines of the image 501 by a plurality of users. Needless to say, the technical idea of the present invention can also be applied to an image display apparatus that performs operations such as reducing an image 501 and closing the image 501. In this case, the image operation means 13c analyzes the movement of the user's finger from the history of “light spot position information” stored in the light spot information storage area 12c, and corresponds to the movement of the user's finger. An image operation command ”is generated and stored in the image operation command storage area 12d, and the projection image generation means 13a generates a“ drawing command ”based on the“ image operation command ”stored in the image operation command storage area 12d. The “drawing command” is generated and output to the projection image controller 17.

  In the embodiment described above, the infrared light emitting device 15 is attached to the user's finger, but the infrared light emitting device 15 may be attached to the user's hand.

  In the embodiment described above, the RAM 12 is used as a storage area for storing “captured image data”, “light spot position information”, and “image operation command”. However, the storage area may be a flash memory or a hard disk. An auxiliary storage device can be used.

  In the embodiment described above, the present invention has been described with respect to the embodiment using the infrared camera as the infrared light emitting device 15 that emits infrared light and the imaging unit 30, but this light emitting device emits light using a light emitting device that emits visible light. The light spot to be picked up may be picked up by the image pickup means 30 for picking up visible light to detect the movement of the user's finger. In this case, the imaging means 30 is provided with an infrared cut filter instead of the visible light cut filter so as to capture visible light.

  Although the present invention has been described above in connection with the most practical and preferred embodiments at the present time, the present invention is not limited to the embodiments disclosed herein. However, the present invention can be appropriately changed without departing from the spirit or concept of the invention that can be read from the claims and the entire specification, and an image display device with such a change should also be understood as being included in the technical scope. I must.

9 Bus 10 Control unit 11 CPU
12 RAM
12a Image data storage area 12b Captured image data storage area 12c Light spot information storage area 12d Image operation command storage area 13 ROM
13a Projected image generating means 13b Light spot information generating means 13c Image operating means 15 Captured image controller 17 Projected image controller 18 VRAM
DESCRIPTION OF SYMBOLS 19 Input part 20 Projection means 30 Imaging means 100 Image display apparatus 150 Infrared light-emitting device 150a Power supply part 150b Infrared light-emitting part 150c Mounting part 501 Projected image 950 Light spot 999 Projection area

Claims (8)

Projecting means for projecting an image onto the projection area;
Imaging means for imaging the projection area and generating captured image data;
Light-emitting means worn on the user's hand;
A light spot information generating means for specifying a position on the projection area of the light emitted by the light emitting means from the captured image data, and generating light spot position information;
Storage means for storing light spot position information generated by the light spot information generating means;
Image operation means for analyzing the movement of the user's hand on the projection area based on the light spot position information stored in the storage means and generating an image operation command for operating the image projected on the projection area; ,
An image display device comprising:   The image display device according to claim 1, wherein the image operation unit further generates an image operation command when the intensity of light detected from the captured image data is equal to or greater than a predetermined value. When the position of the light detected from the captured image data is within the area of the image projected by the projection means, and the light intensity is a predetermined value or more,
The image display device according to claim 2, wherein the image operation unit generates an image operation command for changing an image state according to the movement of the position of the light. When the position of the light detected from the captured image data is within the area of the image projected by the projection means, and the light intensity is a predetermined value or more,
The image display device according to claim 3, wherein the image operation unit generates an image operation command for moving an image in accordance with the movement of the position of the light. The light emitting means is provided to irradiate the projection area with light,
The imaging means images reflected light reflected by the projection area by the light emitted by the light emitting means,
The image according to any one of claims 1 to 4, wherein the light spot information generating means recognizes the reflected light imaged by the imaging means as a light spot and generates light spot position information. Display device.   6. The image display device according to claim 5, wherein the light emitting means is attached to the fingertip and emits divergent light in the fingertip direction.   The image display apparatus according to claim 1, wherein the projecting unit is arranged to face the projection area. The light emitting means emits infrared rays,
The image display apparatus according to claim 1, wherein the imaging unit is an infrared camera that captures infrared rays emitted by the light emitting unit.

Images