JP3804302B2 - Display device and information recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a display device suitable for performing a presentation or the like by projecting a display image by a projection device such as a liquid crystal projector, a pointer used in the display device, and an information recording medium suitably used for controlling the display device. Is.
[0002]
[Prior art]
In recent years, presentations in a form in which electronic image information is enlarged and projected by a projection display device such as a liquid crystal projector have been widely performed. At present, in such a presentation, it is common to display the contents (contents) prepared in advance as they are. However, if the display contents can be directly manipulated and processed on the display screen as necessary, In interactive presentations such as education, the possibility of using a display device instead of the conventional whiteboard and blackboard as a presentation tool is expanded.
[0003]
The operation of the image information may be movement or deletion of a part of the displayed information, and it is necessary to indicate the operation target position on the display screen. To indicate this position, a pointer that is an object that can be fixed on the screen and can be moved to an arbitrary position by hand can be used to control the display position of the display image portion in conjunction with the position of the pointer. Then, since the display image, which is an image, can be operated as if an existing object is operated, a display device for presentation that is easy to use can be realized.
[0004]
Japanese Patent Laid-Open No. 2-171822 is taken up as a conventional example of a large screen screen interface using an instruction pin as a pointer, although the use is different from that of a presentation.
[0005]
Japanese Patent Laid-Open No. 2-171822 discloses that an instruction pin corresponding to a processing work is inserted into an input means provided on a large image screen on which a drawing image is displayed, whereby the coordinate position and the processing work are input from the input means. A large-screen system device that performs processing operations on the coordinate position portion of a drawing image by a processing means is disclosed.
[0006]
FIG. 11 is a diagram illustrating an example of a conventional large screen system apparatus. The operator selects a figure from the request panel 2 on the console 1, and the CPU 5 extracts the drawing data from the disk device 6 corresponding to the selected figure and displays it on the large screen screen 7 through the video projector 8. An instruction pin 3 whose resistance value is changed in accordance with the work contents processed by the operator is pointed out at the coordinate position of the target location on the screen 7. Then, the coordinate input device 9 receives the pin 3 by the process I / O, transmits the processing work contents to the CPU 5 by the coordinate position and the resistance value of the pin 3, and the CPU 5 receiving the processing operation executes the processing. The result is output to the screen 7 through the projector 8.
[0007]
[Problems to be solved by the invention]
However, the above-described conventional device requires the dedicated coordinate input device 9 and the instruction pin 3, and also requires the instruction pin 3 whose resistance value is changed according to the business content. Can only be used within the range of, and was not versatile.
[0008]
SUMMARY OF THE INVENTION An object of the present invention is to provide a display device, a pointer, and an information recording medium for presentation, which solves the above-described problems, is capable of operating a display image from the screen, is versatile, and is easy to use. That is.
[0009]
[Means for Solving the Problems]
In order to solve the above-mentioned problem, the first invention is based on projection means for projecting a display image including at least one display object on a screen, imaging means for capturing an image of the screen, and output of the imaging means. Pointer detection means for detecting the coordinate position of the pointer whose position is temporarily fixed on the screen, and pointer-display object association processing for associating the pointer detected by the pointer detection means with the display object And a display image control means for controlling the display of the display object associated with the pointer based on the output of the pointer-display object association processing means. For this reason, if a pointer is operated on the screen, an operation such as movement of an associated display object can be performed, and the display object can be handled like an object.
[0010]
According to a second aspect of the present invention, in the display device according to the first aspect, the pointer detection unit includes a motion detection unit that performs frame difference processing of the captured image captured by the imaging unit and detects a motion of the captured image. And the display image control means stops the projection of the video light of the projection means when the movement on the captured image is stopped based on the output of the motion detection unit, and causes the pointer detection means to stop the pointer. The display device is characterized in that the coordinate detection is performed. For this reason, the pointer can be reliably detected without being affected by the image light. Further, since the projection is stopped only when the movement on the captured image is detected and stopped, that is, when the movement of the pointer is completed, the quality of the display image is hardly affected.
[0011]
According to a third invention, in the display device of the second invention, the display image control means causes the projection means to project a plain image when the pointer detection means performs coordinate detection of the pointer. This is a characteristic display device. For this reason, since a plain image is projected, the contrast between the pointer and the background is improved, and the pointer can be easily detected.
[0012]
According to a fourth invention, in the display device of the first invention, the pointer-display object association processing means calculates a distance between a reference position of the display object and the pointer, and the distance is equal to or less than a predetermined value. The display device is characterized in that the pointer and the display object are related to each other when the time is reached. For this reason, the pointer and the display object can be easily associated with each other and can be distinguished even when there are a plurality of display objects on the screen.
[0013]
According to a fifth invention, in the display device according to the first invention, the pointer includes at least one switch unit and a communication unit that communicates a switch signal of the switch unit with the image display control unit. This is a display device characterized by the above. Therefore, in addition to the movement of the display object, an operation such as designation of the range of the display object can be performed.
[0014]
A sixth invention is a display device according to the fifth invention, wherein the pointer can arbitrarily set the display object on a display screen of the projection means. Therefore, it is not necessary to set the display object at the time of data creation, and the range and number can be set on the spot, so that the degree of freedom of display and operation is expanded.
[0015]
7th invention is a pointer provided with at least 1 switch part, the communication part which communicates the switch signal of the said switch part, and the adsorption | suction means adsorb | sucked to a screen. For this reason, various operations of the display object can be performed from the screen screen.
[0016]
An eighth invention is an information recording medium used for controlling a display device that projects a display image including at least one display object on a screen and picks up an image of the screen, and is temporarily positioned on the screen. Based on the first information for detecting the coordinate position of the fixed pointer, the second information relating the pointer and the display object detected based on the first information, and the second information And third information for controlling the display of the display object associated with the pointer.
[0017]
According to a ninth aspect of the present invention, in the information recording medium of the eighth aspect, the first information includes information for performing a frame difference process on the captured image and detecting a motion of the captured image. The information 3 is characterized in that, based on the information to detect the motion, when the motion on the captured image is stopped, the projection of the video light is stopped and the coordinates of the pointer are detected. It is a medium.
[0018]
According to a tenth aspect of the present invention, in the information recording medium of the ninth aspect, the third information projects a plain image when performing coordinate detection of the pointer based on the first information. Is an information recording medium.
[0019]
An eleventh aspect of the invention is the information recording medium of the eighth aspect of the invention, wherein the second information is obtained by calculating a distance between a reference position of the display object and the pointer, and the distance becomes a predetermined value or less. Further, the information recording medium is characterized in that the pointer and the display object are related to each other.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings.
[0021]
(First embodiment)
FIG. 1 is a diagram showing a first embodiment of a display device according to the present invention. The display device 10 of this embodiment includes a projection device 11, an imaging device 12, a pointer detection unit 13, a pointer-display object association processing unit 14, a display image control unit 15, and the like.
[0022]
The projection device 11 projects a display screen 31 including at least one display object 32 onto the screen 30. For example, a liquid crystal projector is used. The image pickup device 12 picks up an image of the screen 30 and uses, for example, a CCD camera.
[0023]
The pointer detection unit 13 is for detecting the coordinate position of the pointer 20 temporarily fixed on the screen 30. The pointer-display object association processing unit 14 is for associating the pointer 20 with the display object 31. The display image control unit 15 is for controlling the display of the display object 31 related by the position of the pointer 20. Here, the pointer detection unit 13, the pointer-display object association processing unit 14, and the display image control unit 15 are configured by one microprocessor unit (MPU) 16. The MPU 16 includes a microprocessor and peripheral circuits, and may exist independently of the display device 10 or may be built in the display device 10. The pointer 20 is an object for instruction such as a disk shape in which an attracting means such as a permanent magnet that can be temporarily fixed to the screen 30 is provided on the back surface.
[0024]
FIG. 2 is a flowchart showing a main routine of the operation of the display device according to the present embodiment. The MPU 16 performs motion detection processing of the captured image on the screen 30 based on the video imaged by the imaging device 12 (S100), and then performs control processing of the projected video light (S200). Note that S100 and S200 are necessary when the projection of video light is stopped and coordinate detection is performed each time movement on the screen is stopped, and can be omitted in other cases.
[0025]
Next, the MPU 16 performs pointer coordinate detection processing (S300), further performs pointer-object association processing (S400), determines whether or not to continue processing (S500), and in the case of affirmation , The process returns to S100, and in the case of negative, the process ends.
[0026]
FIG. 3 is a flowchart showing the motion detection process on the screen. In the motion detection process on the screen (S100), it is determined whether or not a motion is detected (S101). If the result is negative, the process is repeated. If the result is affirmative, it is determined whether or not the movement has been stopped (S102). If the result is negative, the process is repeated. If the result is affirmative, the process ends. In the motion stop detection process, the difference between frames is processed for each captured image. In this frame difference process, the motion of an image is detected by taking a difference between frames taken by the imaging device 12 (for example, 30 frames per second).
[0027]
FIG. 4 is a flowchart showing the projection video control process. The projection video control process (S200) starts projecting a “full white” plain image (S201), and then performs screen imaging (S202). This screen imaging is for use in pointer coordinate detection processing (S300) and pointer-object association processing (S400) described later. Next, the projection of the “full white” plain image is terminated (S203), and the normal video light projection state is restored.
[0028]
FIG. 5 is a flowchart showing the pointer coordinate detection process. In the pointer coordinate detection process (S300), for example, an image having a certain area is extracted by performing a labeling process or the like, which is an image processing technique for analyzing an area in an image and analyzing the area of each area (S301). ). Then, the barycentric coordinates are detected (S302), and the process is terminated. The center-of-gravity coordinates are detected for each coordinate when there are a plurality of images having a certain area.
[0029]
FIG. 6 is a flowchart showing the pointer-object association process. The pointer-object association process (S400) determines whether or not the pointer 20 has been added on the screen 30 (S401). For example, the determination is made based on whether or not the number of pointers 20 has increased. If the result in S401 is affirmative, it is determined whether or not the pointer 20 is within the area of the display object 32 (S402). If the result is negative, the process ends. If the result in S402 is affirmative, the pointer 20 is associated with the display object 32 (S403). If the result is negative, the process is terminated.
[0030]
FIG. 7 is a diagram for explaining the operation of the display device according to the first embodiment. A display object 32 titled “1. Purpose” and a display object 33 titled “2. Configuration” are projected on the projection screen 31 of the screen 30. These display objects 32, 33, and the like have their ranges fixed in advance when creating display image data.
[0031]
Now, assume that the operator tries to place the pointer 22 at the upper left corner of the display object 33 on the screen. At this time, movement detection processing is performed to detect the movement of the pointer 22 and the hand (S101), and when the movement stops (S102), a solid image is projected (S201), and the screen 30 is imaged ( S202), the pointer 22 is detected (S300). The reason for detecting when the movement stops is that the hand 22 may be moving even if the pointer 22 is fixed. The reason for projecting the plain image is to improve the contrast between the pointer 22 and the background and prevent a detection error of the pointer 22 and the like. Further, since the plain image may be about one to several frames, it cannot be recognized even with the naked eye, and the display image is not affected.
[0032]
When the pointer 22 is fixed, an image of a certain area is extracted (S301), and the coordinates of each center of gravity are detected (S302). Then, it is determined that the pointer 22 is added on the screen 30 (S401). When the pointer 22 approaches a predetermined distance of the display object 33, it is determined that the pointer 22 is within the area of the display object 33 (S402). The display object 33 is related (S403). In this way, the pointer 22 on the screen 30 is detected, and the pointer 22 is related to the display object (part of display information) 33.
[0033]
Next, by operating the pointer 22, the related display object 33 can be operated. For example, as shown in FIG. 7B, the display object 33 can be moved by moving the pointer 22 on the display screen 31 as indicated by an arrow A. At this time, the MPU 16 (display image control unit 15) performs control so that the relative position between a certain pair of pointers and the display object is kept constant. In addition, since a pointer is detected every time a motion image is detected on the screen and the motion stops, a plurality of pointers can be used at the same time. It is also possible to move. In this way, the display object 33 can be handled like a physically existing object on the screen 30, and the operation of the display screen 31 can be performed efficiently. Therefore, it is possible to provide a display device for presentation that is easy to use sensuously.
[0034]
Note that the MPU 16 (display image control unit 15) does not display the display object when the pointer is removed from the screen for a certain set of pointer and display object.
[0035]
According to the first embodiment, since an image is captured on the screen, there is an advantage that the display object can be operated without using a special screen or pointer.
[0036]
(Second Embodiment)
FIG. 8 is a diagram showing a second embodiment of the display device according to the present invention. In addition, the part which fulfill | performs the same function as 1st Embodiment attaches | subjects the same code | symbol, and abbreviate | omits the overlapping description suitably. The second embodiment uses a personal computer 17 and a pointer 20B with a communication device. The personal computer 17 has substantially the same function as the MPU 16 of the first embodiment, and further includes a communication device 18.
[0037]
FIGS. 9A and 9B are a front view and a side view showing a pointer according to the second embodiment. The pointer 20 </ b> B of this embodiment includes a cylindrical main body 21, an attracting portion 22 such as a permanent magnet that can be temporarily fixed to the screen 30, and a push provided on the front side of the main body 21. A button 23 and a communicator 24 that is provided inside the main body 21 and transmits an instruction signal to the outside in response to an ON signal of the push button 23 are provided. The push button 23 corresponds to a mouse button. For example, the push button 23 can be operated on the icon (or near the icon) to perform the same operation as the click. That is, the pointer 20 </ b> B can be used as if the icon display image is directly operated by the push button 23.
[0038]
FIGS. 9C, 9D, and 9E are a front view, a circuit diagram, and a usage explanatory diagram showing another embodiment of the pointer. The pointer 20C of this embodiment is provided with a reflective photo interrupter 25 in place of the push button 23 described above. The photo interrupter 25 includes an LED 26 and a phototransistor 27 as shown in FIG. And the phototransistor 27 can detect the reflected light level of LED26 with a finger | toe, and can output an ON signal, as shown in FIG.9 (e).
[0039]
FIG. 10 is a diagram for explaining the operation (object recognition) of the display device according to the second embodiment. In the display device of the second embodiment, the pointer 20B is attracted to the first diagonal point A of the object 34 and the push button 23 is turned on and designated (S501), and then the second diagonal point B is set. By picking up the pointer 20B and designating the push button 23 again (S502), the object 34 can be recognized. Therefore, according to the second embodiment, the object 34 having an arbitrary position and size can be set in the presentation.
[0040]
As shown in FIG. 10C, the first diagonal point A may be designated by the pointer 20B, and the second diagonal point B may be designated by the bar-type pointer 20D. .
[0041]
(Deformation)
The present invention is not limited to the embodiment described above, and various modifications and changes are possible, and these are also within the equivalent scope of the present invention.
[0042]
(1) The pointer detection process has been described with an example in which the projected image is all white, but may be all black. In the case of a plain image, the luminance may be set to a predetermined value with another color. Note that making the projected image all black is equivalent to stopping the projection of the video light.
[0043]
(2) The pointer detection process has been described by taking area detection as an example, but the color of the pointer may be detected. In this way, a plurality of pointers can be easily identified. The shape of the pointer is not limited to a disk, but may be a rectangle, a rod, and used like an underline, or a frame to surround a display object.
[0044]
(3) Although the adsorption means has been described by taking a permanent magnet as an example, a suction cup or an adhesive tape (such as a removable double-sided tape) may be used.
[0045]
(4) Although the pointer switch has been described in the example of designating the diagonal of the range of the display object, it can also be used for application control. For example, menu display, function selection, display content switching (displaying more detailed content), and the like may be performed. Two or more switches may be provided. If the switch is pressed twice, the usage method may return to the original screen.
[0046]
(5) When a personal computer is used as in the second embodiment, the control program of the above embodiment can be stored in a propppy disk, CD-ROM, or other information recording medium.
[Brief description of the drawings]
FIG. 1 is a diagram showing a first embodiment of a display device according to the present invention.
FIG. 2 is a flowchart showing a main routine of the operation of the display device according to the first embodiment.
FIG. 3 is a flowchart showing a motion detection process on the screen of the display device according to the first embodiment.
FIG. 4 is a flowchart showing a projection video control process of the display device according to the first embodiment.
FIG. 5 is a flowchart showing pointer coordinate detection processing of the display device according to the first embodiment;
FIG. 6 is a flowchart showing pointer-object association processing of the display device according to the first embodiment.
FIG. 7 is a diagram explaining the operation of the display device according to the first embodiment.
FIG. 8 is a diagram showing a second embodiment of a display device according to the present invention.
FIG. 9 is a diagram showing a pointer of the display device according to the second embodiment.
FIG. 10 is a diagram illustrating an operation (object recognition) of the display device according to the second embodiment.
FIG. 11 is a diagram illustrating an example of a conventional large screen system apparatus.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 Display apparatus 11 Projection apparatus 12 Imaging apparatus 12 Pointer detection part 14 Pointer-display object correlation process part 15 Display image control part 20 Pointer 30 Screen 30
31 Display screen 32 Display object

Claims (4)

Projection means for projecting a display image including at least one display object on the screen;
Imaging means for imaging the screen image;
Pointer detection means for detecting a coordinate position of a pointer temporarily fixed on the screen based on an output of the imaging means;
Pointer-display object association processing means for associating the pointer detected by the pointer detection means with the display object;
Display image control means for controlling the display of the display object associated with the pointer based on the output of the pointer-display object association processing means;
Including
The pointer detection unit includes a motion detection unit that performs frame difference processing of a captured image captured by the imaging unit and detects a motion of the captured image.
The display image control means stops projection of the video light of the projection means when the movement on the captured image is stopped based on the output of the motion detection unit, and causes the pointer detection means to stop the coordinates of the pointer. Let the detection occur,
A display device. The display device according to claim 1,
The display image control unit causes the projection unit to project a plain image when the pointer detection unit performs coordinate detection of the pointer;
A display device. An information recording medium used for controlling a display device that projects a display image including at least one display object on a screen and captures an image of the screen,
First information for detecting a coordinate position of a pointer temporarily fixed on the screen;
Second information relating the pointer detected based on the first information and the display object;
Third information for controlling display of the display object associated with the pointer based on the second information;
Including
The first information includes information for performing frame difference processing of a captured image and detecting a motion of the captured image,
The third information is based on the information to detect the movement, and when the movement on the captured image is stopped, the projection of the video light is stopped and the coordinate detection of the pointer is performed.
An information recording medium characterized by the above. The information recording medium according to claim 3,
The third information is to project a plain image when performing coordinate detection of the pointer based on the first information.
An information recording medium characterized by the above.

Images