JPH1139095A - Presentation system, method, and pen input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a more natural presentation capable of displaying screens without any special tool, by detecting the apparent length and direction of a specified formed object by making the specified formed object face toward the screen at the time of displaying a screen and displaying a pseudo pointing rod in an effective form on the display screen based on information. SOLUTION: Picture data on the screen 202 and around the screen are composited with picture information, which is displayed by a projection device 203 at present by a control part. Data of the picture, which are obtained by composition, namely, picture data without a demonstrator 201 are compared with digital picture data, which are previously obtained, and different area is extracted. Thus, the picture part of the demonstrator in front of the whole display screen is extracted. The position, the direction and the length showing the pseudo pointing rod 206 are calculated so that a point on the display area which the demonstrator points by using the specified formed objet 205 is pointed from the information and the pseudo pointing rod 206 in the previously decided form is displayed.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a presentation device, a method, and a pen input device, and more particularly, to a device for recognizing a pointing operation on the display device by imaging both the display device and the operator. The present invention relates to a presentation device, a method, and a pen input device such as an ultrasonic digitizer device that calculates coordinates using propagation of ultrasonic waves from a pen device.

[0002]

2. Description of the Related Art Conventionally, when instructing an image or the like on a display device for the purpose of presentation or the like, an instructor actually uses a telescopic rod antenna-shaped insertion rod or an optical instruction means using a semiconductor laser or the like. And directly or indirectly instruct the object displayed on the display device.

Further, in the case of using an ultrasonic digitizer, proximity has not been adopted because of its structure or its accuracy is better than that of an electromagnetic induction system. Also, with the recent increase in size of display devices, the use of ultrasonic digitizer devices having a large coordinate input area is about to be performed.

[0004]

However, in the case of using an actual insertion rod, there is a drawback that it is difficult to see the point where the instruction is given depending on the lighting conditions of the venue or the display device. Also, when the pointing rod is long, fixing the tip at a fixed position places a burden on the user. When a laser pointer or the like is used, it may still be difficult to see depending on the lighting conditions, and furthermore, there is a risk that a light beam emitted from the tip is erroneously irradiated to the eyes.

Further, when inputting data to a large-sized display device using an ultrasonic digitizer,
In order to transmit ultrasonic vibrations from the pen device to the ultrasonic sensor unit existing at the end of the coordinate input area, it is necessary to input a larger energy to the propagation body of the digitizer device,
The pen device itself is also large, and there has been a problem that a coordinate point at which an operator attempts to input coordinates is displaced from a point at which coordinates are input when the pen device actually contacts the propagation body.

In an environment using a large display device, a presentation is made in front of more people,
Coordinates must be input as needed, and it is necessary to frequently change a pen device, a pointing stick, or an optical pointer device for inputting to the coordinate input device.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned problems, and when a presenter points to a screen, a specific shaped object such as a fingertip is pointed at the screen so that a specific shape viewed from the front of the screen is displayed. It is an object of the present invention to provide a presentation device that detects an apparent length, a direction, and the like of an object, and displays a pseudo stick having an effective shape on a display screen based on the detected information.

Another object of the present invention is to provide a pen device including a laser pointer device.

[0009]

According to the present invention, an image pickup means for picking up an image including a first shape, and a position indicated by the first shape based on the image picked up by the image pickup means. And a display means for displaying a second shape indicating a position detected by the detection means.

[0010] According to the above configuration, the display screen can be instructed without having a special device such as a laser pointer or a telescopic pointing stick, and the presenter has less burden.
A more natural presentation device can be provided.

Further, the pen device has ultrasonic wave generating means for generating ultrasonic waves and laser light output means for outputting laser light.

According to the above arrangement, a pen device is used as a laser pointer device when pointing to a remote place, and when an input is made from a digitizer device, the pen device is brought into contact with the surface of the digitizer device so that the pen device of a normal ultrasonic digitizer is used. As a result, it is not necessary for the operator to change a plurality of pen devices and laser pointer devices, and a comfortable input operation and pointing operation can be performed.

[0013]

BEST MODE FOR CARRYING OUT THE INVENTION

(First Embodiment) FIG. 1 is a block diagram showing a schematic configuration of a presentation device according to a first embodiment of the present invention. Here, 101 is a display device, 102 is a control unit that controls the entire presentation device, 103
Is a memory serving as a work area when a control program used by the control unit 102 is loaded and operating in accordance with the control program. 104 is a memory for storing and loading a program to be loaded into the memory 103 and various information. An external storage device, 105 is a pattern dictionary in which specific shape pattern information is stored, and 106 is an imaging unit for capturing a surrounding image including the display device 101 and the explainer.

FIG. 2 is a diagram showing a presentation device and an explainer according to the first embodiment of the present invention. In FIG. 2, 201 is a presenter giving a presentation, 202 is a screen constituting a part of a display device, 203 is a projection device constituting a display device together with a screen 202, and 204 is arranged alongside the projection device. An imaging device 205, a specific shape object of the presenter, 206
Is a pseudo stick displayed by the display device.

FIG. 3 shows a state in which a presentation is performed using the presentation apparatus of FIG. 2 when viewed from the front. In FIG. 3, reference numeral 302 denotes the projection device 20.
3, the shadow of the explainer 201 formed when the projection is performed, and 303 indicates the object pointed by the explainer 201. Reference numeral 304 denotes a range (display area) in which display is performed by the projection device 203, and reference numeral 305 denotes an imaging device 2.
04 shows a visual field range (imaging area). FIG. 4 shows an image actually captured by the imaging device 204.

FIG. 12 shows an outline of a specific shaped object 205 extracted based on an image obtained by the imaging device 204 of the presentation device having the above-described configuration, and a pseudo insertion stick 206 is extracted based on the extracted data. It is a flowchart which shows the processing procedure displayed. Hereinafter, the first embodiment of the present invention will be described with reference to the flowchart of FIG.

First, in step S1201, an image is taken by the imaging device 204, image data of an image including the display area 304 and the explainer 201 as shown in FIG. 4 is obtained, and the obtained image data is controlled as digital data. Input to the unit 102. In the presentation device of the first embodiment, as shown in FIG. 2, a projection type display device including a screen 202 and a projection device 203 is used as the display device 101. As shown, the explainer 201 and the shadow 302 of the explainer may appear shifted. In this apparatus, the projection device 2 is used so that the presenter 201 and the presenter's shadow 302 do not appear to be displaced from the imaging device 204 in this manner.
03 and the imaging device 204 are installed at substantially the same position. As a result, the image obtained by the imaging device 204 does not show the shadow 302 of the presenter as shown in FIG. 4, but includes only the display area 304 and its surroundings, and the image 402 of the presenter and the specific shape object.

Next, in step S1202, based on the digital image data input in step S1201, the image data currently being projected by the projection device 203, and the screen image data when nothing is projected. , The image 402 of the specific shape of the presenter and the presenter
Is extracted.

More specifically, the control unit 102 combines the image data of the screen and the peripheral surface of the screen, which are a group of pixels having substantially the same characteristics, with the information of the image currently displayed by the projection device 203 by the control unit 102. The image data obtained by the synthesis, that is, the image data without the explainer 201 is compared with the digital image data obtained in step S1201, and different regions are extracted. Thereby, it is possible to extract an image part of the presenter standing on the front of the display screen.

Although the extraction method can be implemented by various other image processing techniques, a comparison between the above-described extraction method and a method of extracting an image using only imaging information is as follows.
It goes without saying that the above-mentioned extraction method allows much faster and more accurate image extraction. This is the same in various image processing described later.

Next, in step S1203, edge extraction processing is performed on the image 402 of the presenter and the specific extract extracted in step S1202, and continuous contour information on the extracted edges is detected. FIG. 5 is a diagram in which attention is focused on only the display area 304 in the video obtained by the imaging device. 501 is step S1203
502 in the display screen area of the presenter extracted in
Indicates the contour of the specific shape part held by the explainer on the contour line.

In step S1204, the contour information extracted in step S1203 is used as a unit vector having the same length (continuous normalized vector) divided into a specific direction, for example, 16 divided directions shown in FIG. Is converted into a vector sequence as shown in FIG. FIG. 6 shows the outline 501 of the explainer in FIG. 5 and the outline 502 of the specific shape portion.
FIG. 8 is a diagram showing a state in which the vector is enlarged and is continuously represented by the vector shown in FIG.
And 502 show the replaced vector sequence. In addition,
In FIG. 7, the numbers attached to the vectors are numbered in a specific direction of the vector.

Next, in step S1205, pattern matching is performed on the vector sequence shown in FIG. 6 using specific shape pattern dictionary data as shown in FIG. Hereinafter, an example of the pattern matching in the first embodiment performed in step S1205 will be described.

FIG. 8 is a further enlarged view of the vicinity of the vector column 602 of the specific shape portion shown in FIG. 6, wherein reference numeral 801 denotes the contour of the explainer, and reference numerals 802 to 813 denote the vector column 602 of the specific shape portion. In FIG. 8, the numbers added to the vectors correspond to the numbers given in the direction of FIG. FIG. 9 shows data (specific shape pattern information) indicating the amount of direction change stored in the pattern dictionary 105 shown in FIG. 1, and is used to detect the shape of the specific shape object from the vector sequences 601 and 602 in FIG. Used for In the first embodiment, the difference between the numbers of the representative vectors shown in FIG. 7 is continuously stored as the specific shape pattern information.

Here, the vector sequence shown in FIG. 8 will be described as an example. First, the amount of direction change between the vectors 802 and 803 (hereinafter, referred to as “direction difference”) is determined. In the first embodiment, numbers given in the directions shown in FIG. 7 are used. The direction difference between the vectors 802 and 803 is 0 (= 3
-3), the value satisfies the value 0 stored as the first direction difference shown in FIG. Next, the vector 803
And 804 are obtained. Vectors 803 and 804
Is 0, and is not the value +2 stored as the second direction difference shown in FIG.
Nos. 02 to 804 do not form a part of the specific shape pattern. Similarly, the direction difference between two consecutive vectors is sequentially obtained, such as vectors 804 and 805 and vectors 805 and 806, and the comparison with the specific shape pattern information in FIG. 9 is continued. In the first embodiment, the direction difference between the vectors 805 and 806 is 0 (= 3−3).
3), the direction difference between vectors 806 and 807 is +2 (= 5-
2), the direction difference between vectors 807 and 808 is +4 (= 9−
5), the direction difference between the vectors 808 and 809 is +2 (= 11
−9), and the direction difference between the vectors 809 and 810 is 0 (= 11).
-11), the vectors 805 to 810 match the specific shape pattern information in FIG. As a result, FIG.
805 to 810 are identified as specific shapes.

In FIG. 8, the vectors 807 and 808 at the end of the specific shape portion match the length of the unit vector, but in many cases, they do not actually match. Normal,
Since the thing used as the specific shape object has an elongated shape in most cases, the size of the unit vector is set sufficiently large in a range of a value shorter than the length of the specific shape portion, so that the specific shape The specific shape can be detected without affecting the detection of the length of the portion. After the direction of the vector changes, if the unit vectors in the same direction continue for a predetermined number or less, another method can be used, such as performing pattern matching by regarding the unit vector as a single vector.

Further, 814 and 815 shown in FIG.
When the vector sequence consisting of 02 to 813 is detected to be the contour of the specific shaped object possessed by the explainer, it becomes a reference point of the specific shaped object.

Next, in step S1206, it is determined whether or not a specific shape portion has been detected by the pattern matching in step S1205, and if not detected, the process ends.

If it is determined in step S1206 that a specific shape portion has been detected, the process proceeds to step S120.
Then, the process proceeds to step S7, and the coordinates on the display screen corresponding to the tip 815 of the specific shape portion shown in FIG. Furthermore, the center part 814 of the end part of the entire actual specific shape including the vectors 802 to 804 and 811 to 813 following the vectors 805 to 810 having the same directionality as the vectors 805 to 810 indicating the specific shape part is obtained. The corresponding coordinates on the display screen are obtained by calculation. Then, the obtained tip portion 81
The direction component is derived from the line segment connecting these two points from the coordinate values of the center part 814 of the end part and the fifth part, and the direction indicated by the specific shape part in the coordinates on the display screen is calculated.

In step S1208, step S12
The length of the specific shape portion is detected from the number of the same direction vectors following the vectors 805 to 810 indicating the specific shape portion obtained by the pattern matching 05 (the number of reference vectors 3 or 11 in FIG. 8).

Hereinafter, the detection of the length of the specific shape portion will be described with reference to FIG.

FIG. 10 is a top view of a place where the presenter is giving a presentation in front of the display screen. In the figure, reference numeral 1001 denotes a screen, 1002 denotes a line of sight of the imaging apparatus, 1003 denotes an arm of a presenter, 1005 and 1006 denote specifics viewed from the imaging apparatus when the direction of the specific shape 205 is changed by the presenter 201 It shows the change in the length of the shape. As can be seen from FIG. 10, as the inclination of the specific shape object 205 with respect to the screen 1001 increases, the specific shape object 20 when viewed from the viewing direction 1002 increases.
The apparent length of 5 becomes shorter. Therefore, step S1
At 208, the apparent lengths 1005 and 10 of the specific shape object that change according to the inclination of the specific shape object with respect to the display screen
06 is changed to the vector 805-8 of the specific shape portion in FIG.
It is detected as a change in the number of vectors 802 to 804 and vectors 811 to 813 in the same direction following 10 and is obtained by calculation.

In step S1209, step S12
07 and a position, a direction, and a length for displaying the pseudo pointing bar 206 (FIG. 2) based on the information of the specific shaped object 205 obtained in step S1208, and a pseudo insertion bar having a shape predetermined in step S1210. Is actually displayed on the display device. FIG. 11 shows steps S1207 and S1.
The specific shaped object 205 obtained in 208 and the pseudo pointing stick 2
It is a figure which shows the relationship with 06. In FIG. 11, 110
Reference numerals 4 and 1105 denote coordinate points indicating end points of the specific shape object on the display screen; 1102, a direction in which the specific shape object is directed;
103 indicates the length of the specific shape object. From this information,
The position, the direction, and the length of the pseudo insertion bar 1106 shown in FIG. 11 are calculated so as to indicate the point on the display area to which the presenter points using the specific shape object (step S120).
9) In step S1210, a pseudo pointing bar 1106 having a predetermined shape is displayed.

The above operation shown in the flowchart of FIG. 12 is repeatedly performed.

In the first embodiment, FIG.
As shown in the figure, in order to determine the length of the pseudo-pointing rod according to the length of the specific shape part that changes depending on the inclination of the specific shape object in the screen direction, the specific shape object is marked with a line or color coding etc. So that the presenter has a specific shape according to the mark.

Further, in the present embodiment, a projection display device is used as the display device, but the presentation device according to the present invention is not limited to this, and another display device may be used.

The data registered in the specific shape pattern dictionary is not limited to the above example, and data of another shape such as the shape of the fingertip of the presenter can be registered.

Further, the shape of the displayed pseudo pointing stick is shown in FIG.
The shape is not limited to one, and an arbitrary shape may be displayed.

In the first embodiment, the position, direction, and length for displaying the pseudo pointing stick are determined on the basis of the information on the position, direction, and length of the specific shape object. It is not limited. For example, based on information on the position, direction, and length of a specific shape object, a position on the display screen to which the presenter is pointing is obtained by calculation or the like, so that the obtained position can be recognized by the audience. If there is, any display may be used.

As described above, according to the present embodiment, when a presenter gives a presentation, an object held by the presenter or a part of the shape of the presenter is registered in the specific shape pattern dictionary in advance. By placing the fingertip on the display screen, for example, by changing the angle of the fingertip when viewed from above or below or from the vertical direction with respect to the display screen, it is possible to place the fingertip in a free position and a pseudo shape having an effective shape. A stick can be displayed. This makes it possible to provide a comfortable presentation system that does not require a long and heavy insertion rod or a high-output optical pointer device that is dangerous to the human body.

(Modification 1 of the first embodiment)
In the embodiment of the present invention, the specific shape portion is detected by the pattern matching process, and the entire length of the specific shape object is detected by the number of unit vectors having the same direction following the detected specific shape portion. By adding an imaging device having a field of view viewed from above as shown in FIG. 10, a more accurate calculation of the length of the pseudo-stick can be performed. In this case, from the image of the specific shape object obtained from the imaging device 204, the direction of the specific shape object parallel to the screen, that is, the direction 100 shown in FIG.
The angle of the specific shape object with respect to the screen may be detected in the same manner as when detecting the image No. 2. As a result, the apparent length of the specific shape object can be detected with higher accuracy than the length detection based on the number of unit vectors, and more appropriate pseudo-bar length calculation can be performed. .

(Modification 2 of the first embodiment)
In the embodiment, in order not to display the stick,
Although it was necessary to store the specific shape object, change the shape of the specific shape object, or place the specific shape object out of the field of view of the imaging device, in the first embodiment, the detected specific If the overall length of the shape is less than a certain value,
In the first modification, when the angle between the display screen and the display screen becomes a certain value or more or less, a process of not displaying the pseudo-stick is added, so that the pseudo-stick is easily displayed according to the will of the explainer. Can be controlled, and a more effective presentation can be made.

(Second Embodiment) FIG. 13 shows a second embodiment of the present invention.
1 is a block diagram illustrating a configuration of an entire presentation device including a digitizer device according to an embodiment. Here, 401 is a digitizer device, 402 is a display device, 4
03 is a pen device, 404 is a digitizer controller that controls the entire digitizer device, 405 is a control unit that controls the entire electronic device such as a display device, including the digitizer device according to the present invention, and 406 is a program that controls the electronic device. A memory 407 for loading and executing, or serving as a work area, an external storage device 407 for storing the above-mentioned program or serving as a work area;
Reference numeral 8 denotes a laser pointer control signal for controlling a later-described laser pointer included in the pen device.

FIG. 14 is a diagram showing in detail the pen device 403 of the presentation device according to the second embodiment of the present invention. In FIG. 14, reference numeral 1401 denotes a pen device main body;
03 is a vibrator such as a piezo element for transmitting the frequency of ultrasonic waves, 1402 is a horn for efficiently transmitting vibration from the vibrator 1403 to the pen tip, and 1404 is a vibrator 140.
Reference numeral 1405 denotes the other electrode of the vibrator 1403, reference numeral 1406 denotes a lead wire for transmitting an electric signal to the electrode, reference numeral 1408 denotes a laser pointer unit included in a pen device, and reference numeral 1409 denotes a laser pointer unit. Reference numeral 1410 denotes a lead wire for supplying power to the laser pointer unit 1408, through which a light signal emitted from 1408 passes.

FIG. 15 is a diagram for explaining a mechanism in which the digitizer device 401 according to the second embodiment of the present invention performs coordinate detection. Reference numeral 1501 denotes a main body of the digitizer device, which is a propagation body that propagates ultrasonic vibration; Input area for inputting the digitizer device, 1503 to 1506
A sensor for detecting a pulse-like ultrasonic signal from the pen tip is shown. Reference numeral 1508 is an image depicting a state in which an ultrasonic wave transmitted from the pen tip of the pen device 403 is transmitted through the propagator.
The digitizer controller 404 calculates and detects the coordinate value input by the pen device 403 based on the propagation delay time until the ultrasonic signal transmitted from the pen tip is detected by the plurality of sensor units 1503 to 1506, and detects the coordinate value. Send outside. Reference numeral 1510 denotes a digitizer controller 404.
This shows the output coordinate information.

FIG. 16 is a diagram showing a state in which an input is made to the digitizer device 401 by the pen device 403. In the figure, reference numeral 1611 denotes a carrier, and 161
Reference numeral 2 denotes a light beam emitted from the laser pointer unit 1408.

FIGS. 17 and 18 show a state in which graphic input is performed by the pen device 403 according to the second embodiment of the present invention on a large display and an ultrasonic digitizer integrated with input and output. FIG.

FIGS. 19 and 20 are views showing a state in which pointing is remotely performed using the laser pointer function of the pen device 403 according to the second embodiment of the present invention.

Next, a second embodiment of the present invention will be described in detail with reference to FIGS.

First, the case where the pen device 403 is used as a laser pointer will be described.

In the presentation device of FIG. 13 including the digitizer device according to the second embodiment, the laser pointer control signal 4
At 08, the laser pointer unit 1408 included in the pen device is activated, and the laser beam 1612 passes through the tunnel portion 1409 penetrating the horn portion 1402 of the pen device 403, and is output from the pen tip. The laser beam 1612 is, for example, the point 19 shown in FIGS.
When the explainer operates the pen device 403 so as to point to a desired position on the display device, such as 01, an instruction by the laser becomes possible.

Next, a case where the pen device 403 is used to directly input data to the digitizer device 401 will be described.

To input coordinates directly to the digitizer 401 in the second embodiment, first, the digitizer controller 404
An electric signal for causing pulse-like ultrasonic vibration is transmitted. The vibrator 1403 transmits the electric signal to the electrode unit 14.
04 and 1405, the vibration is converted into mechanical vibration, and the vibration is efficiently transmitted to the pen tip via the horn 1402. Here, since the vibrator 1403 has a cylindrical shape with a hollow center, more efficient conversion into electromechanical vibration is realized.

At this time, when the pen tip is in contact with the propagator as shown in FIG. 16, the ultrasonic vibration is transmitted concentrically from the pen tip as shown by 1508 in FIG.
Eventually, the sensor unit 150 existing at the corner of the propagation body 1501
3 to 1506. At this time, the digitizer controller 404 starts counting by an internal counter (not shown) at the same time that an electric signal for causing ultrasonic vibration is generated to the pen device 403, and the respective sensors 1503 to 1506 at the corners are started. Detect the time difference between the ultrasonic signals that have arrived at. Digitizer controller 4
In 04, the coordinates of the pen tip on the propagator are calculated and detected based on the principle of triangulation based on the detected time difference.
A known method can be used for the algorithm for detecting the coordinates of the ultrasonic digitizer itself.

The detected coordinate information 1510 is sent to the control unit 405 of the entire presentation device, and processing of a pen input locus for display on the display device 402 is performed as necessary.

As shown in FIG. 18, when the operator brings the pen device 403 close to the vicinity of the coordinate input area in order to input coordinates to the input area, the laser light 1612
Since the point 1801 on the display device 402 approaches the input point of the pen device, it is displayed as if it were a proximity in an electromagnetic induction type coordinate input device, that is, like a cursor display in a proximity state on a vertical line of the pen device, A more accurate position can be confirmed before performing an actual input.

(Modification of Second Embodiment) In the second embodiment described above, the laser pointer device is always in operation while the operator is using the pen device, but as shown in FIG. A pen-down detection circuit 2101 with delay for detecting a pen-down signal indicating that the pen device 403 is in contact with the digitizer device 401 between the digitizer controller 404 and the pen device 403;
The operation as a laser pointer may be stopped. In this case, an input is made to the digitizer device 401 by the pen device 403, and as a result, it is detected that the sensors 1503 to 1506 shown in FIG. The pen down signal is held with a delay, and the laser pointer control signal 2102 is controlled in accordance with the delayed pen down signal. When the pen-down detection circuit with delay 2101 determines that the pen device 403 is performing an input operation, or during a certain period in which the input operation is considered to be continuously performed, the operation of the laser pointer unit 1408 is stopped. Can be.

This makes it possible to stop light emission from the pen tip while the operator is inputting to the digitizer device, to prevent glare during input, to realize a comfortable input operation, and to perform input operation with the pen device. Just before starting
A light beam can be emitted from the laser pointer unit in the vertical direction of the pen device. In the ultrasonic digitizer device, a guide function by a proximity function and a comfortable input operation can be both performed.

[0059]

As described above, when the presenter points the screen at a specific shape, the presenter turns the specific shape such as a fingertip on the screen, so that the apparent length and direction of the specific shape viewed from the front of the screen can be determined. Based on the detected information, a pseudo stick having an effective shape can be displayed on the display screen. Thus, the display screen can be instructed without having a special device such as a laser pointer or a telescopic pointing stick, and a more natural presentation device with less burden on the presenter can be provided.

Also, by incorporating a laser pointer device in the pen device, it can be used as a laser pointer device when pointing to a remote place, or by contacting the pen device with the surface of the digitizer device when inputting from a digitizer device. It can be easily used as a pen device of a normal ultrasonic digitizer. Therefore, the operator does not need to change a plurality of pen devices or laser pointer devices, and can perform comfortable input work and pointing work.

[0061]

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a presentation device according to a first embodiment of the present invention.

FIG. 2 is a diagram illustrating a presentation device and an explainer according to the first embodiment of the present invention.

FIG. 3 is a front view showing a state in which a presentation is performed using the presentation device shown in FIG. 2;

FIG. 4 is a diagram illustrating an image actually captured by the imaging apparatus.

FIG. 5 is a diagram focusing on a display area in a video obtained by an imaging device.

FIG. 6 is an enlarged view of the outline of the presenter and the specific shape portion shown in FIG. 5;

FIG. 7 is a diagram showing unit vectors having the same length indicating different directions.

FIG. 8 is a further enlarged view of the vicinity of the vector sequence of the specific shape portion shown in FIG. 6;

FIG. 9 is a diagram showing specific shape pattern information stored in a pattern dictionary.

FIG. 10 is a top view of a place where a presenter is giving a presentation in front of a display screen.

FIG. 11 is a diagram showing a positional relationship between a specific shaped object and a pseudo pointing stick.

FIG. 12 is a flowchart illustrating an operation flow of the presentation device according to the first embodiment of the present invention.

FIG. 13 is a block diagram illustrating a configuration of an entire presentation device including a digitizer device according to a second embodiment of the present invention.

FIG. 14 is a diagram illustrating in detail a pen device of the presentation device according to the second embodiment of the present invention.

FIG. 15 is a diagram illustrating a mechanism for performing coordinate detection by a digitizer device according to a second embodiment of the present invention.

FIG. 16 is a diagram illustrating the operation of a pen device according to the second embodiment of the present invention.

FIG. 17 is a diagram illustrating a state in which a figure is being input by the pen device according to the second embodiment of the present invention.

FIG. 18 is a diagram showing a state in which graphic input is being performed by the pen device according to the second embodiment of the present invention.

FIG. 19 is a diagram showing a state in which pointing is remotely performed using the laser pointer function of the pen device according to the second embodiment of the present invention.

FIG. 20 is a diagram showing a state in which pointing is remotely performed using the laser pointer function of the pen device according to the second embodiment of the present invention.

FIG. 21 is a block diagram illustrating a configuration of an entire presentation device including a digitizer device according to a modification of the second embodiment of the present invention.

[Explanation of symbols]

 202 Screen 203 Projection device 204 Imaging device 205 Specific shaped object 206 Pseudo stick 304 Display region 305 Imaging region 1401 Pen device main body 1402 Horn portion 1403 Transducer 1404, 1405 Transducer electrode portion 1406, 1407 Transducer lead wire 1408 Laser pointer unit 1409 Tunnel part 1410 Lead wire 1501 Carrier 1502 Input area 1503-1506 Ultrasonic sensor

Claims (25)

[Claims] An imaging unit that captures an image including a first shape; a detection unit that detects a position indicated by the first shape based on the image captured by the imaging unit; And a display unit for displaying a second shape indicating a position detected by the display device. 2. The method according to claim 1, wherein the detecting unit extracts a contour of the first shape based on an image captured by the imaging unit, and specifies a position indicated by the first shape based on the extracted contour of the first shape. The presentation device according to claim 1, wherein the detection is performed. 3. The detecting means detects a direction indicated by the first shape, a length of the first shape, and a position on an image captured by the imaging means based on the extracted outline of the first shape. 3. The presentation apparatus according to claim 2, wherein the position detected by the first shape is detected based on a direction indicated by the detected first shape, and a length and a position of the first shape. 4. The detection unit extracts a contour of the first shape based on a difference between the video image including the first shape and the video image not including the first shape, which is captured by the imaging unit. The presentation device according to claim 2 or 3, wherein 5. The presentation according to claim 2, wherein said detecting means extracts a contour of the first shape based on data registered in advance indicating the first shape. apparatus. 6. The apparatus according to claim 1, wherein the first shape indicates a point on a plane, and the imaging unit captures an image from a direction substantially perpendicular to and substantially parallel to the plane. The presentation device according to any one of 2, 4, and 5. 7. The detecting means detects an angle formed by a direction indicated by the first shape and the plane based on an image captured by the imaging means, and determines whether the detected first shape is an angle. The presentation device according to claim 6, wherein a position indicated by the first shape is detected based on an angle between the pointing direction and the plane. 8. A method for comparing the length of the first shape detected by the detection means with a predetermined threshold value, and determining that the length of the first shape is smaller than the threshold value. 4. The presentation apparatus according to claim 3, further comprising a deactivating means for deactivating the display means so as not to display the shape of No. 2. 9. An angle between the first shape detected by the detection means and the plane and a predetermined threshold value, and when the angle is larger than the threshold value, 8. The presentation apparatus according to claim 7, further comprising a deactivating means for deactivating the display means so that the shape of No. 2 is not displayed. 10. The presentation device according to claim 1, wherein the display unit is a projection unit that projects a second shape. 11. An image capturing step of capturing an image including a first shape, a detecting step of detecting a position indicated by the first shape based on the image captured in the image capturing step, and the detecting step A displaying step of displaying a second shape indicating the position detected in the step (c). 12. In the detecting step, a contour of a first shape is extracted based on an image captured in the image capturing step, and a position indicated by the first shape is specified based on the extracted contour of the first shape. The presentation method according to claim 11, wherein the presentation is performed. 13. In the detecting step, a direction indicated by the first shape, a first direction,
The length of the shape and the position on the image captured in the imaging step are detected, and the direction indicated by the detected first shape, and the position indicated by the first shape based on the length and position of the first shape 13. The presentation method according to claim 12, wherein the method comprises: 14. In the detecting step, an outline of the first shape is extracted based on a difference between the image including the first shape and the image not including the first shape captured in the image capturing step. 14. The presentation method according to claim 12, wherein: 15. The presentation according to claim 12, wherein in the detecting step, an outline of the first shape is extracted based on data registered in advance indicating the first shape. Method. 16. The method according to claim 11, wherein the first shape indicates a point on a plane, and the image capturing step captures an image from a direction substantially perpendicular to and substantially parallel to the plane. The presentation method according to any one of 12, 14, and 15. 17. The detecting step detects an angle formed between a direction indicated by the first shape and the plane based on an image captured in the image capturing step, and detects the detected first angle.
17. The presentation method according to claim 16, wherein a position indicated by the first shape is detected based on an angle between the direction indicated by the shape and the plane. 18. A method for comparing the length of the first shape detected in the detecting step with a predetermined threshold value,
14. The apparatus according to claim 13, further comprising a deactivating step of deactivating the display step so as not to display the second shape when the length of the first shape is smaller than the threshold value. Presentation method. 19. An angle between the first shape detected by the detection step and the plane is compared with a predetermined threshold value, and when the angle is larger than the threshold value, 18. The presentation method according to claim 17, further comprising a deactivating step of deactivating the display step so that the shape of No. 2 is not displayed. 20. The presentation method according to claim 11, wherein in the displaying step, a second shape is projected. 21. An ultrasonic wave generating means for generating an ultrasonic wave,
A pen input device comprising: a laser light output unit that outputs laser light. 22. The pen input device according to claim 21, further comprising a cavity for passing the laser light along the central axis. 23. An ultrasonic digitizer device having a propagating body for transmitting ultrasonic vibrations, and a plurality of ultrasonic sensors installed on said propagating body for detecting ultrasonic vibrations, and an ultrasonic wave generating means for generating ultrasonic waves. And a pen input means including a laser light generating means for generating a laser light. 24. The presentation device according to claim 23, wherein the pen input device has a cavity for passing a laser beam along a central axis. 25. A system according to claim 25, further comprising detecting means for detecting that said pen input device is in contact with said propagator, wherein said detecting means detects that said input device is in contact with said propagator. 26. The presentation device according to claim 24, wherein the laser light emitting means is deactivated.