JPH10228346A - Three-dimensional input device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable specific indication or drawing by outputting data meeting a program conditioned previously so as to input two-dimensional coordinate values and an ON/OFF signal as input data. SOLUTION: In response of an entry of a traced object into a specific control area, an ON/OFF data generating means 15 generates ON/OFF data indicating an ON/OFF state. An output data composing means 16 composes output data by combining an ON signal generated by the ON/OFF generating means 15 and two-dimensional coordinate values among three-dimensional coordinate values that a three-dimensional coordinate value acquiring means 11 acquires. The output data composing means 16 composes output data by combining, for example, an X coordinate value and a Y coordinate value among the three- dimensional coordinate values and the ON/OFF data. A data output means 17 is a signal sending-out circuit which outputs the composed output data and also a circuit which communicates it to a mouse interface etc.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional system which generates an on / off signal by a person moving in a predetermined observation space by moving his / her own body, and generating data by combining this signal with the coordinate values of the body. It relates to an input device.

[0002]

2. Description of the Related Art Conventionally, devices such as a mouse, a trackball, and a tablet that can be used on a desk are known as devices that give instructions to a program operating on a computer. These devices sequentially output two-dimensional coordinate data of an X-axis component and a Y-axis component corresponding to a rectangular management area displayed on a display of a computer according to the movement.

In order to use the device to instruct predetermined data or to select ON / OFF, operations such as pressing down a button provided on the device are performed. Data generated by a mouse or the like is usually relative two-dimensional coordinates in a rectangular coordinate system.
About the number is provided.

By the way, when computer graphics image data is created on a computer, a paint program is used. In this case, the type and color of a brush are selected by using the above-mentioned device. Drawing is performed according to the locus of the dimensional coordinates.

On the other hand, a three-dimensional coordinate measuring device is known as a device for measuring the position of an object moving in an observation space in real time. For example, as an image processing apparatus that captures an observation space with two CCD cameras, identifies a target color existing in this screen, and calculates the spatial coordinates of the target based on the center of gravity of the color, "QuickMAG III" of Applied Measurement Laboratory is known.

Here, a colored marker is set as a tracking target, and the marker is set at a predetermined part of a human, and the three-dimensional coordinate value of the marker is continuously recorded in real time by "QuickMAG III". Can be obtained. In addition, if markers of different colors are installed on the same number of (or less than) the number of color types that can be distinguished by the image processing apparatus, the three-dimensional coordinate values of each of the plurality of markers are calculated. Can be obtained at the same time.

[0007] Further, an ultrasonic wave generating source
If a magnet is installed and an ultrasonic wave or a magnetic sensor is used as a three-dimensional coordinate measuring device, three-dimensional coordinate values relating to at least one predetermined part of a person can be continuously obtained in real time in the same manner as described above. it can.

As described above, if a person moves in a predetermined space or moves his / her limb using QuickMAG III or the like, an instruction is given to a program operating on a computer, or a paint program is used. Since the trajectory data for drawing can be input, there is no need to operate a troublesome device, and artistic expression and the like can be realized more directly by using one's own body.

[0009]

By the way, the program corresponding to the above-mentioned conventional tabletop device operates by a continuous input signal of two-dimensional coordinates and an on / off signal. Therefore, by the three-dimensional coordinate measuring device that measures the position of the object moving in the observation space in real time, the three-dimensional coordinate values of the human limbs in the observation space are continuously obtained, and the obtained three-dimensional coordinate values are obtained. May be used as input data of a program corresponding to a conventional desktop device. In this case, the three-dimensional coordinate value must be converted into a combination of the two-dimensional coordinate and the on-off signal, and the operation of converting the three-dimensional coordinate value into a combination of the two-dimensional coordinate and the on-off signal is complicated. There is a problem that is.

According to the present invention, a three-dimensional coordinate value obtained by a three-dimensional coordinate measuring device for measuring a position of an object moving in an observation space in real time is input, and a human moves in space using a body. In a device that can be directed or drawn by operating the limbs,
It is an object of the present invention to provide a three-dimensional input device in which an operation of converting a three-dimensional coordinate value into a combination of a two-dimensional coordinate and an on / off signal is easy.

The present invention is also directed to a case where a plurality of humans use the body in the observation space to move or move the space, or to instruct or draw by moving their limbs, and to provide the individual with those human physiques. It is an object of the present invention to provide a three-dimensional input device capable of adjusting differences between individuals and exercise abilities.

Furthermore, the present invention provides a method for providing a plurality of persons with different body in different places when instructing or drawing by moving the space using the body or moving the limbs in the observation space. Provided is a three-dimensional input device that allows a user to virtually share coordinate axes when instructing or drawing by moving a space using the body or moving a limb in different observation spaces. The purpose is to do so.

[0013]

SUMMARY OF THE INVENTION According to the present invention, an on / off signal is generated by moving a tracked object into a predefined management area, and the tracked object is passed or moved within the management area. A two-dimensional coordinate value is extracted from the three-dimensional coordinate value generated by the above, and the extracted two-dimensional coordinate value and an on / off signal are output.

[0014]

DESCRIPTION OF THE PREFERRED EMBODIMENTS FIG. 1 is a block diagram showing a three-dimensional input device 100 according to one embodiment of the present invention.

The three-dimensional input device 100 includes a three-dimensional coordinate marker acquisition means 11, a coordinate tracking means 12, a management area definition data storage means 13, an entry detection means 14, an on / off data generation means 15, an output data It has assembling means 16 and data output means 17.

The three-dimensional coordinate marker acquiring means 11 is a means for acquiring, in real time, three-dimensional coordinate values of a tracking target installed at a predetermined part of a human, and is attached to one or more humans in the observation space. This is means for acquiring real-time measurement data of the three-dimensional coordinate value of the marker to be tracked.

The coordinate tracking means 12 is a means for tracking the movement of the tracking target for each tracking target. Specifically, the coordinate tracking means 12 aligns the axes of the three-dimensional coordinate values acquired by the three-dimensional coordinate mark acquiring means 11. This is an example of a means, and a three-dimensional mark acquisition means 11
Is a means for converting the axis in to a logical axis. The management area definition data accumulating means 13 is means for accumulating management area definition data defining a predetermined management area. The entry detection unit 14 is a unit that detects that the tracking target has entered the defined management area.

The on / off data generating means 15 is a means for generating on / off data indicating on / off when a tracking object enters a predetermined management area. The output data assembling means 16 includes the on signal generated by the on / off data generating means 15 and the three-dimensional
Is a means for assembling output data that combines the two-dimensional coordinate values among the three-dimensional coordinate values acquired by. The output data assembling means 16 outputs, for example,
This is a means for assembling output data by combining the X coordinate value, the Y coordinate value, and the on / off data.

The data output means 17 is a signal sending circuit for outputting the output data assembled by the output data assembling means, and is a circuit for sending the data to a mouse interface or the like by communication.

Next, the operation of the above embodiment will be described.

FIG. 2 is a diagram showing the relationship between the marker M to be tracked and the thresholds L1 and L2 for dividing a predetermined management area in the above-described embodiment.

In FIG. 2, a human has a marker M. For example, in an image device capable of identifying colors, if a human wears a glove colored with a color that can be distinguished from a human or another object, the glove becomes the marker M. Then, the three-dimensional marker acquisition means 11 transmits the marker M
(Globe) coordinates are continuously obtained based on the X, Y, and Z orthogonal coordinates.

The threshold value L1 shown in FIG. 2A is set near the head when the person stands upright, is a threshold value on the Z axis in the vertical direction, and the management area R1 is above the threshold value L1. Management area definition data indicating that the management area R1 is an area of Z ≧ L1 is stored in the management area definition data storage unit 13. The position data of the human marker M to be tracked is aligned by the coordinate tracking means 12 and then transmitted to the approach detection means 14.

When the marker M enters the management area R1 which is an area above the threshold L1, the marker M enters the management area R1.
The on-off data generating means 15 notifies the on-off data generating means 15 of the entry by the on-off data generating means 15. For example, the on-off data generating means 15 generates a signal equivalent to an on signal generated when a mouse button is pressed down.

The output data assembling means 16 extracts, for example, only the X coordinate value and the Y coordinate value in the horizontal plane from the three-dimensional coordinate values, and outputs the Z coordinate value (the value of the height from the floor on which a person stands). Is discarded, and the ON signal generated by the ON / OFF data generating means 15 is combined with the X coordinate value and the Y coordinate value. Thus, the X-coordinate value and the Y-coordinate value in the horizontal plane of the three-dimensional coordinate values,
By combining with the ON signal generated by the above, data of the same format as data output by a normal mouse device can be assembled, and this data is output by the data output means 17.

When the marker M enters the management area R2 below the threshold value L2 shown in FIG.
Informs the on / off data generating means 15, and the on / off data generating means 15 generates signal data equivalent to the on signal when the button is depressed by a mouse, for example. A normal mouse has a left button and a right button,
When the marker M enters above the threshold L1, a left mouse signal generated when the left button is pressed is generated, and the marker M
Is generated below the threshold L2, a right mouse signal generated when the right button is pressed is generated, so that the on / off data generation contents may be distinguished according to the management areas R1 and R2. Good. In this way, the same operation as a case of operating a mouse on a display on a computer can be realized by a human moving horizontally in the observation space in the horizontal direction and moving the marker M up and down.

The data assembled by the output data assembling means 16 is not limited to a signal generated by a mouse signal. For example, instead of the on / off data generating means 15 generating an on / off signal, a means corresponding to the on / off data generating means 15 may generate a sound or emit a lamp.

Further, a plurality of persons having the marker M to be observed may be present. In this case, the coordinate tracking means 1
2 individually tracks the coordinate values of a plurality of markers M to be tracked.

FIG. 3 shows a management area R limited to a certain range in the height direction in a state similar to the state shown in FIG.
12 and R22.

The management area R12 shown in FIG. 3A is an area set between the height thresholds L1 and L12, and the management area R22 shown in FIG. L
2 is an area set between L2 and L22. The management areas R12 and R22 are managed by the approach detection means 14.

In the case shown in FIG. 3A, when the marker M enters above the threshold value L1, the on / off data generating means 1
5 generates an ON signal, and when the marker M further enters above the threshold value L12, the generation of the ON signal by the ON / OFF data generating means 15 is stopped. Similarly, FIG.
(2) In the case shown, when the marker M enters below the threshold L2, the on / off data generating means 15 generates an on signal, and when the marker M enters below the threshold L22, the on / off data generating means 15 turns on. The generation of the signal is stopped.

In FIGS. 3A and 3B, the management area may be set to be limited not only in the height direction but also in the horizontal direction and the oblique direction.

FIG. 4 is a diagram showing a state in which the human having the marker M to be tracked is drawing by swinging his arm left and right in the management area R1.

In FIG. 4, a screen S is a screen obtained by projecting a display of a paint program of a computer onto a screen, and is equivalent to a ceiling of a room. In FIG. 4, a threshold L1 on the vertical Z-axis is set near the head in a state where a person stands upright, and the management area R1 is above the threshold L1. Then, when the marker M exists in the management area R1, drawing is performed. That is, at the time T1, the marker M enters above the threshold L1, and at this time, the on / off data generating means 15 generates an on signal, drawing on the screen S starts, and at the time T2, the marker M
Enters below the threshold value L1, the generation of the ON signal by the ON / OFF data generating means 15 stops, and the drawing ends.

That is, only the X coordinate value and the Y coordinate value are extracted from the X coordinate value, the Y coordinate value, and the Z coordinate value output by the three-dimensional coordinate value acquiring means 11, and the operation of discarding the Z coordinate value is performed. The output data assembling means 16 executes the ON signal generated by the on / off data generating means 15, and the X coordinate value and the Y coordinate value. Data in the same format as the data
7 to output data.

At this time, by adjusting the coordinate value of the threshold value L1 in the vertical direction, it is possible to express a tone drawn as if drawing toward the sky.

Further, if the output data assembling means 16 extracts only the X coordinate and the Z coordinate, discards the Y coordinate, and sets the threshold value of the management area in the Y axis direction, the human can place the marker on the upright wall surface. By moving M, it is possible to operate as if drawing on a vertical wall.

FIG. 5 is a diagram showing that the marker M2 has entered the management area RX1 horizontally separated from the marker M1 installed near the center of the person by a predetermined threshold value X1 or more in the above embodiment. It is.

In FIG. 5, the coordinate value of the marker M1 as the origin and the coordinate value of the marker M2 at the tip of the arm are obtained simultaneously by the three-dimensional coordinate marker acquiring means 11. A management area RX1 horizontally separated from the marker M1 serving as the origin by a certain distance X1 or more.
When the marker M2 enters the on-off data generation means 1
5 generates an ON signal.

Instead of setting the management area RX1, a predetermined threshold value is provided in the vertical direction and the diagonal direction (diagonally upward or diagonally downward), and the management area is set in a range exceeding the threshold value in that direction. It may be.

FIG. 6 is a diagram showing an example in which the range in the horizontal direction is limited in the same state as in FIG.

That is, in FIG. 6, the horizontal thresholds X1 and X2 are determined from the marker M1 installed near the center of the human.
And the management area RX12 is set.

[0043] Figure 7, in the above embodiments, the markers M1, which is installed near a human heart, the management area R ₀ 1 away threshold L1 or a polar coordinate system from the marker M1, showing the relationship between the marker M2 FIG.

In FIG. 7, the coordinate value of the marker M1 as the origin and the coordinate value of the marker M2 at the tip of the arm are simultaneously obtained by the three-dimensional coordinate marker acquiring means 11. From the marker M1 as the origin unless the marker M2 enters the management area R ₀ 1 away threshold L1 or a polar coordinate system (FIG. 7 (1)), on-off data generating means 15 generates an OFF signal. Marker M
1, a management area R ₀ 1 that is separated by a distance equal to or more than the threshold L1 in the polar coordinate system
(FIG. 7 (2)), the ON / OFF data generating means 15 generates an ON signal.

In the example shown in FIG. 7, since the management area is set in the polar coordinate system, an ON signal is generated in any direction as long as the arm is extended.

Further, in the example shown in FIG.
Although the polar coordinate system is set on the (-Z plane), the polar coordinate system may be set three-dimensionally, that is, the management area may be set in a dome shape.

FIG. 8 shows management areas R81, R82, R83, R84, R85 on a grid set in the observation space.
FIG. 4 is a diagram showing a state in which a human is passing a marker M to be tracked with the marker.

The example shown in FIG. 8 is to generate a trigger signal which is a signal having a short on-time when passing through a certain point. That is, the time points T1, T2, T3, T4, T
5, management areas R81, R82, R83, R8
4, R85, and these management areas R81, R82,
Each time the signal passes through R83, R84, and R85, a trigger is generated. In this case, the lattice may be set along any one of the X-axis direction, the Y-axis direction, and the Z-axis direction.

With this trigger, when a person having a marker to be tracked moves in the observation space, a sound or a lamp is illuminated every time the person passes through a virtually set grid. You may.

In addition to generating a trigger by passing, a trigger may be generated each time the marker M moves a distance equal to or more than a predetermined amount. In this case, the entry detection unit 14 does not manage the entry of the marker M into the specific management area, but manages the movement distance obtained by the coordinate tracking unit 12.

FIG. 9 is a diagram showing an example of the management area set in the observation space.

For example, when drawing a computer graphics image using a paint program, it is necessary to change the color of the brush. When the color change of the brush is realized by the movement or movement of a human, the management areas Ra1, Ra2,
Ra3, Ra4, Ra5, Ra6, Ra7, and Ra8 are set in a predetermined space, and colors such as red, blue, and green correspond to each of the management areas Ra1 to Ra8. If the marker M is caused to enter the management area Ra2 by a human motion, the brush changes to blue. When the marker M is directed upward and enters the management area above the threshold value L1 and the person moves, a blue locus can be drawn on the screen S.

In addition to changing the color, the effect of the brush (brush thickness,
When a menu item such as changing the line type is selected, it can be realized by the same procedure as described above.

FIG. 10 shows a case where a plurality of persons hold markers M to be tracked, and the management areas R1, R2, R
FIG. 3 is a diagram showing that R4 is adjusted and set.

In the observation space, a plurality of people move with the marker M. For example, when a human moves in the observation space and performs drawing by a paint program, a sense of incongruity occurs unless the on / off data generating means 15 generates a signal at an appropriate timing. In order to avoid this discomfort, it is necessary to manage the management area in accordance with the physique of each person. The threshold L2 for a tall human is set higher, and the threshold L3 for a short human is set lower. The management area for each person is
The entry detection unit 14 uses the management region definition data for each person who is individually stored by the management region definition data storage unit 13 and is an observation target. In order to set the management area, the coordinate tracking means 12 acquires the movement of the operating human, and sets a height of 0.8 times the height from the ground when the hand reaches the uppermost position, for example, The management area R1 is set by setting the threshold value L1.

According to each of the above embodiments, the three-dimensional coordinate values obtained by the three-dimensional coordinate acquisition means 11 for measuring the position of the object moving in the observation space in real time are input and defined in advance. An on / off signal is generated by entering or passing through the management area, and two-dimensional coordinate values are output by moving within the management area, so that a human can move in space using the body or move his limbs. By doing so, it is possible to output data that conforms to a program that assumes two-dimensional coordinate values and on / off signals as input data, and therefore, humans can use the body to move in space or move limbs. By doing so, a predetermined instruction or drawing can be performed under a program using two-dimensional coordinate values and on / off signals as input data.

FIG. 11 is a block diagram showing a three-dimensional input device 101 according to another embodiment of the present invention.

The three-dimensional input device 101 is the same as the three-dimensional input device 100 except that the data communication means 18 is provided.
a and 11b are provided. Further, the three-dimensional input device 101 is an example used when a plurality of observation spaces are provided in different places. In other words, the data communication unit 18 collects the positions of the plurality of markers M obtained from the plurality of three-dimensional coordinate marker obtaining units 11a and 11b set at different places, and the collected plurality of markers M The coordinate tracking means 12 individually tracks the position data. The management of the management area by the entry detection means 14 may be performed for each observation space, and the management of the management area by the entry detection means 14 is executed in a state where the observation space is virtually shared. Is also good. In other words, by matching the origins of the observation spaces with each other and by matching the coordinate axes, a plurality of persons present in different observation spaces can simultaneously draw one computer graphics image.

In the above-described embodiment, the output data assembling means 16 outputs the ON signal generated by the ON / OFF data generating means 15 and the two-dimensional coordinate value of the three-dimensional coordinate values obtained by the three-dimensional coordinate value obtaining means 11. This is a means for assembling output data combining the coordinate values and all the three-dimensional coordinate values (X, Y,
All of the Z coordinate values) may be combined with the on signal generated by the on / off data generating means 15 to assemble the output data.

[0060] In this way, a human can move in space using his / her body or move his or her limbs, and the data conforming to a program that assumes that three-dimensional coordinate values and on / off signals are input data. Can be output, and therefore, when a person moves in space or moves a limb using the body, a predetermined instruction or drawing is performed under a program that uses three-dimensional coordinate values and on / off signals as input data. It can be performed.

Further, in the above embodiment, the ON signal is generated when the coordinate value obtained by the three-dimensional coordinate obtaining means 11 is a predetermined value. The speed may be detected and an ON signal may be generated when the speed is equal to or higher than a predetermined value.

[0062]

According to the first aspect of the present invention, it is assumed that a two-dimensional coordinate value and an on / off signal are used as input data when a person moves in space or moves a limb using a body. Data that is compatible with the program can be output, and therefore, by using a human body to move in space or move a limb, under a program that uses two-dimensional coordinate values and on / off signals as input data, There is an effect that a predetermined instruction or drawing can be performed.

According to the second aspect of the present invention, there is an effect that axis alignment is easy.

According to the third aspect of the present invention, when a plurality of persons in the observation space perform predetermined instructions or drawing by moving the space using their bodies or moving their limbs, their physiques There is an effect that the adjustment can be made according to the individual difference of the individual and the athletic ability. .

According to the fourth aspect of the present invention, in the case where a plurality of persons in the observation space perform predetermined instructions or drawing by moving the space using the bodies or moving the limbs,
There is an effect that the coordinate axes in the observation spaces existing in different places and having different sizes are matched with each other, and the observation space can be virtually shared. .

According to the fifth aspect of the present invention, there is provided a program which is based on the assumption that three-dimensional coordinate values and on / off signals are used as input data when a human moves in a space or moves a limb using a body. Suitable data can be output, and therefore, when a human uses the body to move in space or move a limb, a predetermined program is input under a program using three-dimensional coordinate values and on / off signals as input data. There is an effect that instruction or drawing can be performed.

[Brief description of the drawings]

FIG. 1 shows a three-dimensional input device 100 according to an embodiment of the present invention.
FIG.

FIG. 2 shows a marker M to be tracked in the embodiment.
Is a diagram showing the relationship between a marker M and thresholds L1 and L2 for dividing a predetermined management area.

FIG. 3 is a diagram illustrating management areas R12 and R22 limited in the height direction in a state similar to the state illustrated in FIG. 2;

FIG. 4 shows a case where a human having a marker M to be tracked is
It is a figure showing the state where it draws by waving an arm to the right and left in management field R1.

FIG. 5 is a diagram showing that the marker M2 has entered a management area RX1 horizontally separated by a predetermined threshold X1 or more from a marker M1 installed near the center of a person in the embodiment.

FIG. 6 is a diagram illustrating an example in which the range in the horizontal direction is limited in a state similar to FIG. 5;

[7] In the above embodiments, the markers M1, which is installed near a human heart, the management area R ₀ 1 away threshold L1 or a polar coordinate system from the marker M1, is a graph showing the relationship between the marker M2 .

FIG. 8 is a management area R on a grid set in the observation space;
It is a figure which shows the state which 81, R82, R83, R84, and R85 are passing the marker M which is a tracking target with a human being.

FIG. 9 is a diagram illustrating an example of a management area set in an observation space.

FIG. 10 is a diagram showing that a plurality of persons have a marker M to be tracked, and management areas R1, R2, R3, and R4 are adjusted and set for each physique of each person.

FIG. 11 shows a three-dimensional input device 1 according to another embodiment of the present invention.
It is a block diagram showing No. 01.

[Explanation of symbols]

 11, 11a, 11b ... three-dimensional coordinate mark acquisition means, 12 ... coordinate tracking means, 13 ... management area definition data storage means, 14 ... entry detection means, 15 ... on-off data generation means, 16 ... output data assembling means, 17 ... data output means, 18 ... data communication means, 100, 101 ... three-dimensional input device.

Claims (5)

[Claims] 1. A three-dimensional coordinate marker acquiring means for acquiring, in real time, three-dimensional coordinate values of a tracking target installed in a predetermined part of a human; and storing management area definition data for defining a predetermined management area. Management area definition data storage means; entry detection means for detecting that the tracking target has entered the management area; on / off data indicating on / off when the tracking target has entered the management area. On / off data generating means; assembling output data in which an on signal generated by the on / off data generating means and two-dimensional coordinate values of the three-dimensional coordinate values acquired by the three-dimensional coordinate marker acquiring means are combined. Output data assembling means; and a three-dimensional input device. 2. The method according to claim 1, wherein an axis of the three-dimensional coordinate value acquired by the three-dimensional coordinate marker acquiring means is aligned with a logical coordinate axis, and the coordinated three-dimensional coordinate value is sent to the approach detecting means. A three-dimensional input device having an axis aligning means. 3. The management area definition data according to claim 1, wherein the management area definition data defines a range of the management area according to a physique of each of the plurality of persons when the plurality of persons are plural. A three-dimensional input device, characterized in that the data is input data. 4. The method according to claim 1, wherein the three-dimensional coordinate marker acquiring means includes a plurality of observation spaces for acquiring the three-dimensional coordinate values of the tracking target in real time. To
A three-dimensional input device, wherein the coordinate axes of the plurality of observation spaces are matched with each other via predetermined data communication means, and the tracking target virtually shares the observation space. 5. A three-dimensional coordinate mark acquiring means for acquiring, in real time, three-dimensional coordinate values of a tracking target installed in a predetermined part of a human; and storing management area definition data for defining a predetermined management area. Management area definition data storage means; entry detection means for detecting that the tracking target has entered the management area; on / off data indicating on / off when the tracking target has entered the management area. ON / OFF data generating means; and output data assembling means for assembling output data obtained by combining the ON signal generated by the ON / OFF data generating means with the three-dimensional coordinate values acquired by the three-dimensional coordinate marker acquiring means. A three-dimensional input device, comprising: