JP2004341892A - Instruction input device, instruction input method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an instruction input device which is improved in the operability of the device without requiring mechanical operation or comparatively particular operation, and also to provide an instruction input method and a program. <P>SOLUTION: The 3D positional information of an LED 10 to be fitted to an instruction inputting user which is measured by a 3D measuring instrument 20 on the basis of the receiving state of light emitted from the LED 10 is inputted; speed and acceleration following the movement of the LED 10 are detected on the basis of the inputted 3D positional information; whether the movement of the LED 10 corresponds to previously determined movement is judged on the basis of the detected speed and acceleration; and at the time of judging that the movement of the LED 10 corresponds to the previously determined movement, the execution of processing allowed to correspond to the previously determined movement is instructed. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an instruction input device, an instruction input method, and a program, and more particularly to an instruction input device, an instruction input method, and a program for inputting an instruction based on position information of a light emitting unit.
[0002]
[Prior art]
Conventionally, a two-dimensional mouse has been widely used as a device for inputting instructions to a personal computer or the like. The two-dimensional mouse inputs and inputs xy coordinate values to a personal computer as relative coordinate values. In recent years, a technique for inputting a third coordinate value using this two-dimensional mouse has been proposed.
[0003]
For example, a three-dimensional mouse can be easily achieved by attaching an LED as a light emitter to a finger and attaching a light receiving unit for receiving light from the LED to an upper portion of a screen of a personal computer (for example, see Patent Document 1). . The sensor used here determines the angle of the light source with respect to the sensor, and determines the three-dimensional position of the light source based on the principle of triangulation. The LED receives power as a light source from a personal computer, and signals such as a click, which is a basic operation of a mouse, are sent to the basic software of the personal computer through a wire. That is, a switch that can be pressed by a finger is provided near the light emitting body.
[0004]
In addition, by rotating two balls in two dimensions, not only a movement amount in the x and y axis directions can be input, but also an angle and a rotation angle can be input, and a pointing device that enables input in the z axis direction ( For example, see Patent Document 2), a first optical sensor array in which light converting elements are arranged in a first direction, and a second optical sensor array in which light converting elements are arranged in a second direction different from the first direction. Non-contact type position detection device that generates a signal corresponding to the output change of the optical sensor array when the optical sensor array moves, and thereby determines the amount of movement and the direction of movement (for example, Patent Document 3) Cf.) is known.
[0005]
Further, a remote control device (for example, see Patent Document 4) for recognizing an index with a CCD camera and interpreting the index as a command for a personal computer or the like, and a rotary switch rotated by a finger in an electronic pen are provided. A coordinate input electronic pen (see, for example, Patent Document 5) that determines the degree of change in graphical parameters (line segment thickness, color, shading, gray scale), and movement of an RFID attached to a user's wrist. 2. Description of the Related Art There is known an instruction input system (for example, see Patent Literature 6) that interprets an RFID movement pattern as an input command to another device after recognition by an antenna.
[0006]
Gyration Inc., USA Gyromouse has a built-in auto gyro and is a pointing device that can change the direction of the laser by air operation, but it is relatively heavy, the size is relatively large for the gyro, and it is somewhat expensive. is there.
[0007]
Furthermore, in recent years, a prototype of a device that combines a keyboard and a notepad with a keyboard of a personal computer that applies the concept of half-pressing in the shutter operation of a camera, taking advantage of the characteristic that characters are not input unless you press it strongly like a camera shutter. Was done.
[0008]
In addition, the present applicant provides feedback (change in focus metaphor, hue, and the like) that appeals to at least one of the five senses, and emits light to each boundary of a plurality of divided regions in a three-dimensional space spread in front of the screen. To execute the functions of a two-dimensional mouse, such as clicking, double-clicking, and dragging, according to how the light-emitting means passes through the boundary of each area without using a mechanical mechanism, without using a mechanical mechanism. (Japanese Patent Application No. 2003-96366) has been proposed.
[0009]
[Patent Document 1]
JP-A-10-9812
[Patent Document 2]
JP-A-5-150900
[Patent Document 3]
JP-A-11-24832
[Patent Document 4]
JP-A-11-110125
[Patent Document 5]
JP 2000-47805 A
[Patent Document 6]
JP 2001-306235 A
[0010]
[Problems to be solved by the invention]
However, the above-described conventional three-dimensional mouse is operated by pressing a switch provided near the light emitter with a finger, and thus requires mechanical operation and components for realizing the same as the two-dimensional mouse. The same applies to other instruction input devices such as the above-mentioned conventional pointing device and instruction input system.
[0011]
Further, US Gyration Inc. Gyrmouse Presenter also requires mechanical operation with a finger for operations such as clicking, like a normal two-dimensional mouse. The same applies to a device in which a keyboard and a notepad are stacked.
[0012]
That is, the conventional instruction input device requires relatively fine operations such as pressing a button or a switch, so that it is inconvenient for a person who has relatively difficult mechanical operations.
[0013]
Further, in the three-dimensional instruction input device proposed by the present applicant, since the position of each boundary for dividing the three-dimensional space into a plurality of regions is fixed, the user can use his or her hand or finger on which the light emitting means is mounted. Since it is necessary to move the hand or finger while checking each boundary by moving it to a position that matches the position of each boundary, a detailed operation is required.
[0014]
The present invention has been made in view of the above-described facts, and provides an instruction input device, an instruction input method, and a program that do not require a mechanical operation or a relatively delicate operation and have improved usability. Aim.
[0015]
[Means for Solving the Problems]
In order to achieve the above object, an instruction input device of the present invention has input means for inputting position information of a light emitting unit measured based on a light receiving state of light emitted from a light emitting unit attachable to an instruction input person. Detecting means for detecting a physical quantity related to the speed associated with the movement of the light emitting means based on the input position information; and wherein the movement of the light emitting means is predetermined based on the detected physical quantity related to the speed. Determining means for determining whether or not the movement corresponds to the predetermined movement; and executing the processing associated with the predetermined movement when it is determined that the movement of the light emitting means corresponds to the predetermined movement. And instruction means for instructing.
[0016]
The light emitting means can be mounted on the instruction input person, and is preferably mounted on a finger or a hand. The light emitting means is not particularly limited as long as it emits light, and may be, for example, an LED. The measuring means measures position information of the light emitting means based on a light receiving state of the light emitted from the light emitting means.
[0017]
The input means inputs the position information of the light emitting means. The position information may be, for example, position information on the x, y, and z axes of the three-dimensional position information, or may be only one of them, for example, only the position information on the z axis.
[0018]
The detecting means detects a physical quantity relating to the speed accompanying the movement of the light emitting means based on the position information input by the input means.
[0019]
The determining means determines whether or not the movement of the light emitting means corresponds to a predetermined movement based on the physical quantity relating to the speed detected by the detecting means. For example, a threshold value for a physical quantity related to speed may be determined, and when the threshold value is exceeded, it may be determined that the movement of the light emitting unit corresponds to a predetermined movement.
[0020]
In addition, the predetermined movement may be one or plural. Further, the movement may be constituted by a plurality of fine movements.
[0021]
The instructing means instructs, when the determining means determines that the movement of the light emitting means corresponds to a predetermined movement, execution of a process associated with the predetermined movement.
[0022]
Therefore, according to the present invention, it is possible to input an instruction without requiring a mechanical operation or a relatively fine operation.
[0023]
The instruction input device according to the present invention further includes a storage unit that stores motion information indicating a plurality of different predetermined motions, and the determination unit determines the light emitting unit based on the stored plurality of motion information. Selecting means for selecting at least one piece of motion information corresponding to the motion; and verification means for verifying whether or not the motion of the light emitting means corresponds to the motion indicated by the motion information selected by the selecting means. Can also be configured.
[0024]
The storage unit stores motion information indicating a plurality of different predetermined motions. The motion information is not particularly limited, and may be, for example, information characterizing a predetermined motion. The storage means may be, for example, a volatile memory or a non-volatile memory.
[0025]
The determining means may include a selecting means and a verifying means. The selecting means selects at least one piece of motion information corresponding to the motion of the light emitting means from the plurality of pieces of motion information stored in the storage means. The verification unit verifies whether or not the movement of the light emitting unit corresponds to the movement indicated by the movement information selected by the selection unit.
[0026]
The motion information of the present invention is time-series information of a position, the input unit inputs the position information in a time-series, the selection unit, based on the position information input in the time-series, The at least one motion information may be selected.
[0027]
The information on the time series of the position includes, for example, information on a continuous position on the time axis. The input means can input the position information in time series by inputting the position information at predetermined time intervals, for example, and the selecting means can select at least one of the position information based on the position information input in the time series. When the motion information is selected, for example, at this time, the input time-series position information is compared with motion information (positional time-series information) indicating a predetermined motion. Good.
[0028]
The verification means of the present invention may also verify whether or not the movement of the light emitting means corresponds to the movement indicated by the movement information selected by the selection means based on the detected physical quantity relating to the speed. it can.
[0029]
The physical quantity related to the speed according to the present invention may be at least one of an acceleration and a speed accompanying the movement of the light emitting unit.
[0030]
The instruction input device according to the present invention includes: target information for which execution of a process is instructed; display means for displaying designation information for designating the target information; and the display means for responding to a change in the input position information. Display control means for controlling the display means so that the position of the designated information changes, wherein the instruction means determines that the movement of the light emitting means corresponds to a predetermined movement, For the target information specified by the specification information, it is possible to instruct execution of a process associated with the predetermined movement.
[0031]
The display unit displays target information for which execution of a process is instructed, and designation information for designating the target information. The display means is not particularly limited as long as it displays information, and may be a television screen, a display provided in a personal computer or the like, or a touch panel provided in a PDA or the like. The target information for which the execution of the process is instructed can be an icon, a folder, or the input position itself if the display means is a display or the like provided in a personal computer or the like. The designation information means for designating the target information may be, for example, a cursor used in a personal computer.
[0032]
The display control means controls the display means so that the position of the designated information, for example, the position of the cursor, changes in response to the change of the input position information.
[0033]
The instructing unit instructs, when it is determined that the movement of the light emitting unit corresponds to the predetermined movement, execution of a process associated with the predetermined movement with respect to the target information specified by the specifying information.
[0034]
The instruction means of the present invention is configured such that, among the movements of the light emitting means, which are determined that the movement of the light emitting means corresponds to a predetermined movement, for the target information designated by the designation information, It is possible to instruct execution of a process associated with the movement.
[0035]
For example, when the position information changes during the movement of the light emitting means, the position of the designated information may change corresponding to the change. For example, when the designated information is a cursor used in a personal computer, the display position of the cursor changes, and the target information designated by the cursor may differ between the start point and the end point of the movement of the light emitting unit. . In this case, it may be set in advance which target information is to be instructed to execute a process associated with a predetermined motion.
[0036]
The predetermined movement of the present invention may be a movement that makes one reciprocation in a predetermined direction. For example, this movement can be regarded as a click movement operated by a mouse of a personal computer.
[0037]
The predetermined movement of the present invention is a movement that makes one reciprocation in a predetermined direction within a predetermined time, and includes calculation means for calculating a time accompanying the movement of the light emitting means. It is possible to determine whether or not the movement of the light emitting means is the predetermined movement based on the calculated physical quantity relating to the speed and the time calculated by the calculating means.
[0038]
The predetermined motion of the present invention may be a motion of reciprocating two times in a predetermined direction. For example, this movement can be regarded as a double-click movement operated by a mouse of a personal computer.
[0039]
The predetermined movement according to the present invention is a movement that makes two reciprocations in a predetermined direction within a predetermined time, and includes a calculation unit that calculates a time accompanying the movement of the light emitting unit. It is possible to determine whether or not the movement of the light emitting means is the predetermined movement based on the calculated physical quantity relating to the speed and the time calculated by the calculating means.
[0040]
The predetermined movement of the present invention is such that, after moving in a predetermined direction, after moving in the predetermined direction, further moving in the predetermined direction, a direction orthogonal to the predetermined direction, or a direction sandwiched in both directions. Can be a movement to move. For example, this movement can be regarded as a drag movement operated by a mouse of a personal computer.
[0041]
In the present invention, the predetermined movement is to move in a predetermined direction, and after moving in the predetermined direction, after a lapse of a predetermined time, further in the predetermined direction or a direction orthogonal to the predetermined direction. Alternatively, the moving means includes a calculating means for calculating a time accompanying the movement of the light emitting means, wherein the calculating means calculates a time associated with the movement of the light emitting means, and the determining means calculates the physical quantity relating to the detected speed and the calculating means. It is possible to determine whether or not the movement of the light emitting means is the predetermined movement based on the performed time.
[0042]
The predetermined movement of the present invention may be a movement moving in a direction opposite to a predetermined direction. For example, this movement can be regarded as a movement of a drop operated by a mouse of a personal computer.
[0043]
The predetermined movement of the present invention may be a stationary state.
[0044]
The predetermined movement according to the present invention is a state in which the predetermined movement is stationary for a predetermined time, and further includes calculation means for calculating a time accompanying the movement of the light emitting means, wherein the determination means relates to the detected speed. Based on the physical quantity and the time calculated by the calculating means, it can be determined whether or not the movement of the light emitting means is stationary for the predetermined time.
[0045]
The calculating means for calculating the time accompanying the movement of the light emitting means of the present invention, wherein the determining means determines the movement of the light emitting means in advance based on the detected physical quantity relating to the speed and the calculated time. It can be determined whether or not the movement corresponds to the performed movement.
[0046]
In this way, the time associated with the movement of the light emitting means, which is calculated by the calculating means, can be used as a condition for determining the movement of the light emitting means, together with the physical quantity relating to the detected speed.
[0047]
When the determining means of the present invention determines whether or not the movement of the light emitting means corresponds to a predetermined movement, the determination is made by giving an allowable amount to the movement of the light emitting means or the predetermined movement. be able to.
[0048]
For example, when the instructing person moves the light-emitting unit while wearing it on the hand, unintended minute blurring may occur due to hand wobble. Therefore, it is preferable that the determination unit determines the movement of the light emitting unit or a predetermined movement by giving an allowance.
[0049]
The display control means of the present invention can perform control so as to change a display state of the instruction information based on a physical quantity relating to the detected speed.
[0050]
The display control means of the present invention can control so as to change at least one of a shape, a size, and a color of the instruction information based on a physical quantity related to the detected speed.
[0051]
The display control means of the present invention can control so as to change the size of the target information displayed within a predetermined distance from the position of the designated information.
[0052]
The instruction input device according to the present invention includes: a sound generating unit for outputting a sound; and a sound output control unit for controlling the sound generating unit to change a sound generating state based on a physical quantity related to the detected speed. It may be further provided.
[0053]
Here, the sounding means only needs to generate sound, and may be, for example, a speaker.
[0054]
An instruction input method according to the present invention includes a measurement step of measuring position information of a light emitting unit based on a light receiving state of light emitted from a light emitting unit that can be worn by an instruction input person; and a position measured in the measurement step. An input step of inputting information, a detection step of detecting a physical quantity related to a speed associated with the movement of the light emitting unit based on the input position information, and the light emission based on the detected physical quantity related to the speed. A determining step of determining whether the movement of the means corresponds to a predetermined movement; and, if determining that the movement of the light emitting means corresponds to a predetermined movement, the determining step corresponds to the predetermined movement. And an instruction step of instructing execution of the attached process.
[0055]
According to the present invention, it is possible to input an instruction without requiring a mechanical operation or a relatively detailed operation.
[0056]
The program according to the present invention includes an input step of inputting, to a computer, positional information of the light emitting unit measured based on a light receiving state of light emitted from the light emitting unit that can be worn by the instruction input person; A detection step of detecting a physical quantity related to the speed associated with the movement of the light emitting unit based on the position information; and a movement of the light emitting unit corresponding to a predetermined movement based on the detected physical quantity related to the speed. A determining step of determining whether or not the movement of the light emitting unit corresponds to a predetermined movement, and an instruction step of instructing execution of a process associated with the predetermined movement. And let it run.
[0057]
When the program of the present invention is executed by a computer, it is possible to input instructions without requiring a mechanical operation or a relatively detailed operation.
[0058]
The storage medium for storing the program is not particularly limited, and may be a hard disk or a ROM. Further, it may be a CD-ROM, a DVD disk, a magneto-optical disk, or an IC card. Furthermore, the program may be downloaded from a server or the like connected to a network.
[0059]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0060]
[First Embodiment]
FIG. 1 is a diagram showing a configuration of an instruction input system including a personal computer 30 having a function as an instruction input device according to the first embodiment of the present invention.
[0061]
As illustrated, the instruction input system includes an LED 10, a 3D measuring device 20, and a personal computer 30.
[0062]
The LED 10 is mounted on a finger, a hand, or the like of an instruction input person.
[0063]
The 3D measuring device 20 measures a three-dimensional position based on a light receiving state of light emitted from the LED 10.
[0064]
The 3D measuring device 20 is not particularly limited as long as it can measure a three-dimensional position from a light receiving state of light emitted from a light emitting body such as the LED 10, but the position described in Japanese Patent Application Laid-Open No. 10-9812 can be used. It can be configured using a detection technique or the like.
[0065]
FIG. 2 is a diagram showing a specific configuration of the personal computer 30.
[0066]
As shown in the figure, the personal computer 32 of the personal computer 30 includes a CPU 34, a ROM 36, a RAM 38, and an input / output interface (I / O) 40. The 3D measuring device 20, the display 42, the speaker 44, and the hard disk drive (HDD) 46 are connected to the I / O 40.
[0067]
The HDD 46 is used to execute an instruction input processing routine program (hereinafter, referred to as an instruction input processing program) and an instruction input processing program for instructing execution of predetermined processing based on the speed and acceleration accompanying the movement of the LED 10. And the like are stored. The CPU 34 loads the instruction input processing program and the setting information into the RAM 38 and executes the program.
[0068]
The storage medium for storing the instruction input processing program is not limited to the HDD 46, but may be the ROM 36. Although not shown, a CD-ROM, a DVD disk, a magneto-optical disk, or an IC card connected to the I / O 40 may be used. Furthermore, the program may be downloaded from a server or the like connected to a network.
[0069]
FIG. 3 is a diagram functionally showing the configuration of the personal computer main body 32.
[0070]
As shown in the figure, the personal computer 32 includes a command generation unit 50, a mouse driver 52, an OS 54, and an image driver 56.
[0071]
The command generation unit 50 receives the three-dimensional position information measured by the 3D measurement device 20 and detects the speed and acceleration accompanying the movement of the LED 10. Further, based on the detected speed and acceleration, the movement of the LED 10 is determined by a button operation on a general mouse equipped with buttons (hereinafter referred to as a two-dimensional mouse), ie, click, double-click, drag, It determines which of the movements corresponds to AND and drop, generates a command corresponding to the determination result, and outputs it to the mouse driver 52.
[0072]
FIG. 4 is a diagram specifically illustrating an example of each of the click, double-click, and drag-and-drop instruction operations.
[0073]
Here, the xyz coordinate system is defined by setting the direction from the 3D measuring device 20 toward the hand of the instruction input user as the z-axis and a plane orthogonal to the z-axis as an xy plane including the x-axis and the y-axis. The direction away from the 3D measurement device 20 on the z-axis is defined as a plus direction.
[0074]
If the screen of the display 42 of the personal computer 30 and the position of the 3D measuring device 20 match, the z-coordinate value is the distance from the screen, and the screen can be regarded as a substantially xy plane.
[0075]
In the present embodiment, the movement of the click rapidly moves in a direction approaching the 3D measuring device 20 (minus direction of the z-axis) within a preset time, and then moves in the opposite direction (plus direction of the z-axis). ) (That is, one reciprocation on the z-axis), which corresponds to the movement A in the figure.
[0076]
The double-click movement is set as a movement in which the click movement is repeated twice continuously (that is, makes two reciprocations on the z-axis) within a preset time, and corresponds to the movement of B in the figure. I do.
[0077]
The movement of drag and drop is composed of the movement of drag and drop, and corresponds to the movement of C in the figure. The drag is set as a movement of rapidly moving in the minus direction of the z-axis and then slowly moving in the minus direction or on the xy plane after a preset time has elapsed. Note that there is no time limit for the movement of slowly moving in the minus direction or on the xy plane. Drop is set as a movement that moves rapidly in the positive direction of the z-axis.
[0078]
The personal computer 30 has a threshold value of the speed and acceleration associated with the movement (in this embodiment, V ₀ , A ₀ ) Is set as an absolute value, and a threshold value of the time associated with the movement (in this embodiment, T1 ₀ , T2 ₀ ) Is set. The command generation unit 50 compares the detected speed and acceleration with the set speed and acceleration thresholds, compares the time associated with the movement of the LED 10 with the set time threshold, and It is determined whether or not the movement corresponds to the previously set movement.
[0079]
In addition, by making a determination using the acceleration, the state where the LED 10 is rapidly moving and the state where the LED 10 is not moving, that is, the state where the instruction input person is consciously moving his / her hand, and the state where the instruction input person is consciously moving the hand, are free from the intention to input the instruction. It can be distinguished from the state where the hand is moving.
[0080]
Further, by making a determination using the speed, it is possible to recognize that the LED 10 has been moved by a certain distance, and it is possible to determine the actual movement of the LED 10. By using the speed as a judgment factor, it is possible to recognize a smaller movement as compared with a case where the movement distance itself is calculated and used from the three-dimensional position information.
[0081]
In FIG. 4, the state of acceleration is indicated by a solid arrow, and the state of speed is indicated by a dotted arrow.
[0082]
The mouse driver 52 receives a command from the 3D mouse / command generation device 50 and outputs the command to the OS 54.
[0083]
The OS 54 interprets a command input from the mouse driver 52 and executes a process corresponding to the command.
[0084]
The image driver 56 performs a process for displaying an image corresponding to the movement of the LED 10 on the display 42 under the control of the OS 54.
[0085]
Although not shown, the personal computer 32 also has a sound driver. The sound driver performs processing for causing the speaker 44 to emit a sound corresponding to the movement of the LED 10 under the control of the OS 54.
[0086]
Hereinafter, the instruction input processing according to the present embodiment will be described.
[0087]
The instruction input person moves the hand wearing the LED 10 in front of the 3D measuring device 20 (light receiving area). The position of the LED 10 changes according to the movement of the hand. The three-dimensional measuring device 20 measures the three-dimensional position of the LED 10 at predetermined time intervals. The three-dimensional measuring device 20 sequentially outputs the three-dimensional position information of the LED 10 to the personal computer 30.
[0088]
FIGS. 5 to 7 are flowcharts showing a main routine of the instruction input process performed by the CPU 34 of the personal computer 30.
[0089]
FIG. 8 is a diagram illustrating an example of the movement of the LED 10 corresponding to the double-click movement.
[0090]
8, the horizontal axis represents the time axis, and the vertical axis represents the z axis. Thick solid lines indicated by points B0 to B4 indicate the locus of movement of the LED 10. The thin solid arrow indicates the state of acceleration, and the dotted arrow indicates the state of speed.
[0091]
The movement of the LED 10 on the time axis indicated by the bold solid line, and the acceleration and speed associated with the movement are actually very small, but are exaggerated in the drawing.
[0092]
Hereinafter, the instruction input process will be described using the flowcharts of FIGS. 5 to 7 in comparison with FIG.
[0093]
Although not shown in each flowchart, the personal computer 30 inputs the three-dimensional position information of the LED 10 from the 3D measuring device 20 at predetermined time intervals. Then, every time an input is made, the speed and acceleration accompanying the movement of the LED 10 are detected based on the input three-dimensional position information. In the present embodiment, the velocity and acceleration on the z-axis are detected using the z-coordinate values included in the input three-dimensional position information.
[0094]
For example, the speed can be detected by dividing the difference between the z coordinate values of the three-dimensional position information by the time difference, and the acceleration can be detected by dividing the detected speed by the time difference. Since the direction away from the 3D measurement device 20 is the positive direction of the z-axis, if the LED 10 is moved in a direction away from the 3D measurement device 20, the signs of the speed and acceleration become +, and the 3D measurement device 20 If it is moved in the approaching direction, the signs of the speed and the acceleration become-.
[0095]
In step 100 of the flowchart of FIG. 5, the value obtained by adding a minus sign to the acceleration detected as described above is the acceleration threshold A ₀ It is determined whether or not it has exceeded.
[0096]
As described above, if the LED 10 is moved in a direction approaching the 3D measuring device 20, the signs of the speed and the acceleration become-. Therefore, in this case, the speed and the acceleration have positive values by adding a minus sign. If the LED 10 is moved in a direction away from the 3D measurement device 20, the speed and the acceleration become negative values by adding a minus sign. Also, as described above, the threshold V ₀ And threshold A ₀ Is set as an absolute value.
[0097]
From this, the value obtained by adding a minus sign to the acceleration is the threshold A ₀ Is determined, it is possible to determine whether or not the LED 10 has been moved in a direction approaching the 3D measurement device 20 with a sufficient acceleration.
[0098]
In step 100, -acceleration ≦ A ₀ If it is determined that the above-mentioned condition is satisfied, the standby state is maintained until the next three-dimensional position information is input from the 3D measuring device 20. In FIG. 8, the state before the point B0 corresponds to the standby state.
[0099]
Also, -acceleration> A ₀ If it is determined that this is the case (corresponding to the point B0 in FIG. 8), the instruction input person has moved his hand with his or her will, so the flow shifts to step 102 to start the timers T1 and T2.
[0100]
Here, the timer T1 is a timer used to measure the time from the start of movement in a certain direction to the start of movement in a direction opposite to the certain direction. For the timer T1, the threshold T1 ₀ Is set.
[0101]
The timer T2 is a timer used to determine a double-click movement. For the timer T2, the threshold T2 ₀ Is set.
[0102]
In step 104, the value obtained by adding a minus sign to the speed is the threshold value V ₀ It is determined whether or not it has exceeded. Similarly to the acceleration, the speed is also given a minus sign so that the threshold V ₀ Compare with
[0103]
In step 104, -speed≤V ₀ If it is determined that the above is true, the process proceeds to step 116, the timers T1 and T2 are reset, and the process returns to the standby state.
[0104]
In step 104, -speed> V ₀ If it is determined that the acceleration is equal to the point B1 in FIG. ₀ It is determined whether or not it has exceeded. Here, for the sake of clarity of the movement direction of the LED 10, the acceleration is given a + sign for convenience.
[0105]
In step 106, + acceleration ≤ A ₀ If it is determined that the threshold value T1 is satisfied, the process proceeds to step 108. ₀ It is determined whether or not it has exceeded. Here, the timer T1 ≦ T1 ₀ If it is determined that is, the process returns to step 106, and then the speed and acceleration are detected and determined based on the three-dimensional position information input from the 3D measuring device 20.
[0106]
In step 106, + acceleration> A ₀ If it is determined that the threshold value T1 is satisfied, the process proceeds to step 110. ₀ It is determined whether or not:
[0107]
At step 110, the timer T1> T1 ₀ If it is determined that the movement of the LED 10 is not satisfied, the movement of the LED 10 does not correspond to any of the movements set in advance. Therefore, the processing shifts to step 116, the timers T1 and T2 are reset, and the processing returns to the standby state. At step 110, the timer T1 ≦ T1 ₀ If it is determined that the speed is less than or equal to the predetermined time, the operation of the LED 10 is performed within a preset time. ₀ It is determined whether or not it has exceeded.
[0108]
In step 112, −speed ≦ V ₀ If it is determined that the movement of the LED 10 is not satisfied, the movement of the LED 10 does not correspond to any of the movements set in advance. Therefore, the processing shifts to step 116, the timers T1 and T2 are reset, and the processing returns to the standby state. -Speed> V ₀ If it is determined that the movement of the LED 10 is satisfied, the process proceeds to step 114 to perform a click process (corresponding to the point B2 in FIG. 8) because the movement of the LED 10 corresponds to the previously set movement of the click.
[0109]
More specifically, referring to the functional configuration diagram of FIG. 3, the command generation unit 50 outputs a command for instructing execution of a process associated with a click movement to the mouse driver 52. The command generation unit 50 outputs the command in the same format as a command by a button operation on the two-dimensional mouse. As a result, the OS 54 to which the command has been input via the mouse driver 52 can interpret the command and execute appropriate processing in the same manner as a two-dimensional mouse.
[0110]
After executing the click process in step 114, the process proceeds to step 120 in FIG. 6, where the timer T1 is reset and started. The processing after this step is processing for determining whether or not the movement of the LED 10 is a double-click movement.
[0111]
In step 122, the value obtained by adding a minus sign to the next detected acceleration is the threshold A ₀ It is determined whether or not it has exceeded. -Acceleration ≤ A ₀ If it is determined that the timer T1 is equal to ₀ It is determined whether or not it has exceeded.
[0112]
At step 124, the timer T1> T1 ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. At step 124, the timer T1 ≦ T1 ₀ If it is determined that is, the process returns to step 122, and then the speed and acceleration are detected and determined based on the three-dimensional position information input from the 3D measuring device 20.
[0113]
In step 122, -acceleration> A ₀ If it is determined that the timer T1 is equal to ₀ It is determined whether or not:
[0114]
At step 126, the timer T1> T1 ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. At step 126, the timer T1 ≦ T1 ₀ If it is determined that the speed is the threshold V, ₀ It is determined whether or not it has exceeded.
[0115]
In step 128, -speed ≦ V ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. In step 128, -speed> V ₀ If it is determined that the time is not longer, the process proceeds to step 130, where the timer T1 is reset and started (corresponding to the point B3 in FIG. 8).
[0116]
In step 132, the next detected acceleration is the threshold A ₀ It is determined whether or not it has exceeded. Here, + acceleration ≤ A ₀ If it is determined that the timer T1 is equal to ₀ It is determined whether or not it has exceeded.
[0117]
At step 134, the timer T1> T1 ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. Timer T1 ≦ T1 ₀ If it is determined that is, the process returns to step 132, and then the speed and acceleration are detected and determined based on the three-dimensional position information input from the 3D measuring device 20.
[0118]
In step 132, + acceleration> A ₀ If it is determined that the timer T1 is equal to the threshold T1, the process proceeds to step 136. ₀ It is determined whether or not:
[0119]
In step 136, the timer T1> T1 ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. Timer T1 ≦ T1 ₀ If it is determined that the timer T2 is equal to the threshold T2, the process proceeds to step 138. ₀ It is determined whether or not:
[0120]
The timer T2 measures the time from when the click motion starts. Threshold T2 ₀ Is set in advance as the limit of the time required for the double-click movement. Therefore, the timer T2 and the threshold T2 ₀ Can be determined whether the movement of the LED 10 corresponds to the movement of the double click.
[0121]
At step 138, the timer T2> T2 ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. Timer T2 ≦ T2 ₀ If it is determined that the speed is the threshold V, ₀ It is determined whether or not it has exceeded.
[0122]
In step 140, + speed ≦ V ₀ If it is determined that the time is not longer, the process proceeds to step 144, the timers T1 and T2 are reset, and the process returns to the standby state. + Speed> V ₀ If it is determined that the movement of the LED 10 is satisfied, the process proceeds to step 142 to perform the double-click processing (corresponding to the point B4 in FIG. 8), since the movement of the LED 10 corresponds to the previously set double-click movement. .
[0123]
In the double-click processing, similarly to the click processing, the command generation unit 50 outputs a command for instructing execution of the processing associated with the double-click movement to the mouse driver 52. The OS 54 to which the command has been input via the mouse driver 52 can interpret the command in the same manner as a two-dimensional mouse, and execute appropriate processing corresponding to the double-click movement.
[0124]
After step 142, the process moves to step 144, resets the timers T1 and T2, and returns to the standby state.
[0125]
Note that the double-click motion is not particularly limited to FIG. 8 as long as the motion satisfies the above-described conditions of speed, acceleration, and time. For example, the start point of the second click on the z-axis (ie, point B2) does not need to be the same position as the start point of the first click on the z-axis (ie, point B0).
[0126]
On the other hand, in step 108 of FIG. 5, the timer T1> the threshold T1 ₀ If it is determined that the movement of the LED 10 is satisfied, the process moves to step 150 in FIG. 7 to perform the drag process because the movement of the LED 10 corresponds to the movement of the drag set in advance.
[0127]
Specifically, the command generation unit 50 outputs to the mouse driver 52 a command for instructing execution of the process associated with the drag motion, similarly to the click process. The OS 54 to which the command has been input via the mouse driver 52 interprets the command and executes an appropriate process corresponding to the drag movement.
[0128]
The drag process is a process that is usually performed after the click process. For example, an object such as an icon selected by the click process can be dragged (moved).
[0129]
After step 150, the process proceeds to step 152, where ₀ It is determined whether or not it has exceeded. + Acceleration ≤ A ₀ If it is determined that the drag process is performed, the process returns to step 150, and the drag process is continued. Also, + acceleration> A ₀ If it is determined that the speed is equal to or smaller than the threshold V, ₀ It is determined whether or not it has exceeded.
[0130]
In step 154, + speed ≦ V ₀ If it is determined that the drag process is performed, the process returns to step 150, and the drag process is continued. + Speed> V ₀ When it is determined that the movement of the LED 10 is satisfied, the process proceeds to step 156 to perform a drop process because the movement of the LED 10 corresponds to the movement of the preset drop.
[0131]
In the drop process, similarly to the drag, the command generation unit 50 outputs a command for instructing execution of the process associated with the drag motion to the mouse driver 52. The OS 54 to which the command has been input via the mouse driver 52 interprets the command and executes an appropriate process corresponding to the drag movement.
[0132]
After step 156, the process moves to step 158, resets the timers T1 and T2, and returns to the standby state.
[0133]
In step 108 of the above-described instruction input processing, the threshold value T1 is determined in order to determine whether the movement is a drag movement. ₀ Is used, but the threshold T1 ₀ Alternatively, another threshold value may be provided, and the determination may be made based on the threshold value.
[0134]
In the present system, an object to be instructed to execute a process associated with a movement such as a click or a double-click (an object includes, for example, an icon, a folder, a button, or a data input position). Is performed at the same time as the main routine of the above-described instruction input process for performing a process of displaying a cursor for designating on the display 42. The cursor is displayed at a position corresponding to the size of the display 42 based on the x and y coordinate values included in the three-dimensional position information measured by the 3D measuring device 20. An object displayed at a position indicated by the cursor (hereinafter, referred to as a designated position) is to be processed. Actually, the designated position of the cursor corresponds to the display position of the cursor, and is represented by x and y coordinate values.
[0135]
Although the cursor can use the current display routine called from the OS, the program of the display processing routine for displaying the user-defined cursor or expression is previously designated as a subroutine of the above-mentioned instruction input processing routine. It is included in the input processing program.
[0136]
FIG. 9 is a flowchart showing a display processing routine. This display processing routine is executed every predetermined time.
[0137]
In step 180, three-dimensional position information is acquired.
[0138]
In step 182, the display position of the cursor is moved according to the three-dimensional position information. In the present embodiment, the display position of the cursor is moved according to the change in the x coordinate value and the y coordinate value included in the three-dimensional position information input from the 3D measuring device 20.
[0139]
When the command generation unit 50 outputs a command to the mouse driver 52, the command generation unit 50 includes information on the designated position of the cursor in the command and outputs the command. Accordingly, for example, when the movement of the LED 10 is a click movement, if an object such as an icon is displayed at the designated position of the cursor, a process of selecting the icon is executed. Further, even if an object such as an icon is not displayed, a process of selecting the designated position of the cursor itself is executed. Further, if a button is displayed at the designated position of the cursor, a process of pressing the button is executed.
[0140]
As described above, by displaying the cursor in accordance with the three-dimensional position information, it is possible to easily input and instruct the processing for the object displayed at the designated position of the cursor.
[0141]
As is clear from the flow of the instruction input process described above, after the click command is output and the icon or the position is selected (step 114), when the LED 10 is slowly moved (step 122, N In addition, since the standby state is maintained (Step 100, N), the cursor can be moved by the above-described display processing routine while maintaining the selected state. .
[0142]
As described above, the three-dimensional position information of the LED 10 is input, the speed and acceleration accompanying the movement of the LED 10 are detected, and based on the detected speed and acceleration, whether the movement of the LED 10 corresponds to the preset movement. Since it is determined whether or not to execute the process associated with the preset motion, it is possible to input the instruction without performing a mechanical operation such as a button operation or a relatively fine operation. it can.
[0143]
In addition, since a preset movement including time is set, and the time associated with the movement of the LED 10 is used as a judgment material in addition to the speed and acceleration, more movements can be set as preset movements.
[0144]
Note that, in the present embodiment, an example has been described in which the speed and the acceleration are detected using the difference between the z coordinate values of the three-dimensional position information, but the (x, y, z) coordinate values may be used instead of the z coordinate values. It is also possible to detect the speed and acceleration from. Further, in the present embodiment, an example has been described in which the motion is determined based on the speed and acceleration detected from the z-coordinate value. However, in other directions, for example, the speed in the up-down direction or the left-right direction for the instruction input person. Alternatively, the motion may be determined based on the acceleration. In that case, the position of the cursor may be moved based on a coordinate value on a two-dimensional plane orthogonal to the other direction.
[0145]
Also, the threshold A ₀ , V ₀ , T1 ₀ , T2 ₀ Can be arbitrarily changed. For example, the LED 10 is mounted on the hand of the user who inputs the instruction on a trial basis, the movement (three-dimensional position) is measured, and the speed, acceleration, and time associated with the movement of the hand of the input user are detected, and the detected value is detected. The setting of the threshold can be changed based on the threshold value. By setting the threshold value according to the instruction input person in this way, usability is further improved.
[0146]
In the present embodiment, an example in which an instruction is input only by the movement of the LED 10 has been described. However, for example, a switch or button for instruction input is provided separately from the LED 10, and the instruction input and the button press by the movement of the LED 10 are provided. It is also possible to properly use the instruction input by a mechanical operation such as.
[0147]
Further, although the description has been omitted in the above-described embodiment, other movements, for example, a mouse-down movement performed by a two-dimensional mouse (a movement in a state where a button is kept pressed) are also corresponding movements. Can be set in advance, and the execution of the process can be instructed by judging from the speed, acceleration, and time.
[0148]
[Second embodiment]
In the above-described first embodiment, an example has been described in which the movement is determined based on the speed and acceleration on the z-axis. However, when the x-coordinate value or the y-coordinate value changes during the movement of the LED 10, , Even if the conditions of the velocity and acceleration on the z-axis are satisfied, it can be determined that the movement does not correspond to the preset movement. In this case, each movement may be set as a movement in which the x and y coordinate values do not change from the start to the end of each movement.
[0149]
However, it is difficult for the user to actually move the hand while fixing the x and y coordinate values. Therefore, in the present embodiment, an example will be described in which an allowable range of x and y coordinate values is provided to determine a motion. Note that the configuration of the instruction input processing system of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.
[0150]
In the double-click movement, for example, the step shown in FIG. 10 can be used instead of step 142 in FIG. 6 in the first embodiment.
[0151]
After step 140, in step 160, the x, y coordinate values in the first click movement and the x, y coordinate values in the second click movement are within a predetermined allowable range (for example, each coordinate value). Each time, it is determined whether it is within ± 5 × (3/100) mm).
[0152]
In FIG. 8, the x and y coordinate values in the first click movement may be the position of point B0 or the position of point B1 in FIG. Similarly, the x and y coordinate values in the second click movement may be the position of point B2 or the position of point B3.
[0153]
If it is determined in step 160 that the value exceeds the allowable range, the process proceeds to step 144 without performing the double-click process. Accordingly, if the change in the x-coordinate value or the y-coordinate value exceeds the allowable range and the movement of the LED 10 looks like a W-shaped locus, it is not regarded as a double-click movement.
[0154]
If it is determined in step 160 that the movement is within the allowable range, the movement of the LED 10 is determined to be a double-click movement, and a double-click process is performed in step 162.
[0155]
As described above, by providing an allowable range for the movement, the burden on the instruction input person is relatively reduced.
[0156]
In the present embodiment, an example has been described in which it is determined whether the x and y coordinate values of the points B0 (or B1) and B2 (or B3) in FIG. 8 are within an allowable range. The x and y coordinate values at the first B0 point are stored, and the x and y coordinate values of the B0 point when passing through the B1, B2, B3, and B4 points. May be determined for each coordinate value to determine whether the difference is within an allowable range. If it is determined at any point that it has exceeded the allowable range, it immediately returns to the standby state. When it is determined that the points B3 and B4 are out of the allowable range, the state in which the processing associated with the click movement is performed may be maintained.
[0157]
Further, in the present embodiment, an example has been described in which an allowable range is set for the x and y coordinate values and the motion is determined. However, the motion is determined by setting an allowable range for the speed in the x and y directions. You can also. For example, the speed in the x and y directions is detected together with the speed in the z-axis direction, and is used for determining the movement of the LED 10.
[0158]
In this case, if the difference between the velocities in the x and y directions exceeds the allowable range, it is determined that the movement of the LED 10 does not correspond to a preset movement.
[0159]
The determination may be made using both the x and y coordinate values and the speed in the x and y directions, or may be made using one of the allowable ranges.
[0160]
Further, the determination based on the allowable range is not limited to the double-click motion, and other motions (movements such as click and drag) can be similarly determined by providing an allowable range.
[0161]
Furthermore, even when the designated position of the cursor is slightly deviated from the object (for example, an icon, etc.) that the instruction input person wants to specify as a processing target, x and y are set so that the object is specified as a processing target. An allowable range of coordinate values may be set. Thus, it is possible to instruct execution of a process on a desired target without requiring a detailed operation.
[0162]
[Third Embodiment]
In the above-described first embodiment, when execution of a process associated with a movement such as a click or a double click is instructed (step 114, step 144, step 150, step 156), the designated position of the cursor is set. Is instructed to execute the process for the object displayed in. Specifically, when the command generation unit 50 outputs a command to the mouse driver 52, the command generation unit 50 includes information on the designated position of the cursor and outputs the command.
[0163]
However, as in the example shown in the second embodiment, if an allowable range is provided for the x and y coordinate values, the designated position of the cursor may change during the movement of the LED 10.
[0164]
In this case, it is necessary to set in advance which position information of a plurality of designated positions in the movement is to be included in the command and output.
[0165]
For example, when the position of the first click (the position of the point B0 or B1 in FIG. 8) of the LED 10 is different from the position of the second click (the position of the point B2 or B3 in FIG. 8) in the double-click movement. It is necessary to set in advance which position information is to be output to the mouse driver 52. In general, the position of the first click is often the position that the instruction input person wants to specify, so that information on the position may be included in the command (hereinafter, this processing is referred to as position lock). Do). In this case, information on the position of the first click is stored in a predetermined area of the RAM 38 until a command is output, and when the command is output, the information on the position is read from the predetermined area and used. Is required.
[0166]
In this case, the change of the x and y coordinate values is limited to the allowable range, but the display position of the cursor is fixed to the position of the first click, and the instruction input person is made to recognize the position. You can also.
[0167]
However, when drawing a continuous line segment with drawing software or the like to create a drawing, it is preferable to always use the latest x, y coordinate values. In this case, since the latest x and y coordinate values may be included in the command, unlike the case of position lock, there is no need for special processing such as reading out the stored position information.
[0168]
Although whether or not to lock the position may be set in advance, it may be determined whether or not to lock the position according to the process being executed.
[0169]
In the present embodiment, an example in which a determination is made according to a process being executed will be described with reference to FIG.
[0170]
In step 200, it is determined whether or not the process being executed on the personal computer 30 is a position lock prohibition process. For example, as described above, if the process being executed is a drawing process using drawing software, it is determined that position lock is prohibited.
[0171]
If an affirmative determination is made in step 200, the latest position information may be used, so the process proceeds to step 204, and an instruction is issued to execute a process associated with the determined movement. In this case, the command generation unit 50 includes the latest position information in the command and outputs the information to the mouse driver 52.
[0172]
If a negative determination is made in step 200, in step 202, the locked position information stored in a predetermined area of the RAM 38 (for example, in the case of a double-click movement, the first click Is read out. In step 204, execution of the process associated with the determined movement is instructed. In this case, the command generation unit 50 includes the information of the read position in the command and outputs it to the mouse driver 52.
[0173]
The timing at which the position information is stored in the RAM 38 can be set in advance. For example, in the case of a double-click movement, it is possible to set which point from point B0 to point B4 in FIG. 8 is stored.
[0174]
As described above, by outputting a command by designating any position information in the movement of the LED 10, it is possible to appropriately process even if the designated position of the cursor changes during the movement. Can be.
[0175]
[Fourth Embodiment]
In the present embodiment, a description will be given of a process in a case where a preset motion is set as a stationary state for a predetermined time. That is, the movement is determined based on time, not speed or acceleration.
[0176]
Note that the configuration of the instruction input processing system of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.
[0177]
Hereinafter, a case will be described as an example where the preset double-click movement is constituted by the click movement shown in the first embodiment and a state in which the double-click movement is stationary for a predetermined time after the click movement. Will be explained. In this embodiment, as in the second embodiment, an allowable range is provided, and if the change in the position of the LED 10 is within the allowable range, it is determined that the LED 10 is stationary.
[0178]
The flow up to the click processing (step 114 in FIG. 5) is the same as that of the first embodiment, and thus the description is omitted. However, in this embodiment, since the timer T2 is not used, only the timer T1 is started in step 102 of FIG.
[0179]
The processing of this embodiment after step 114 will be described with reference to the flowchart in FIG.
[0180]
In step 300, the timer T1 is reset and started.
[0181]
In step 302, it is determined whether or not the timer T1 is less than a preset time threshold Tth. Tth is a preset threshold value of the stationary time.
[0182]
If it is determined in step 302 that T1 <Tth, in step 304, it is determined whether or not the LED 10 has moved from the first click position to a position beyond the allowable range. If a negative determination is made here, the process returns to step 302. If the determination is affirmative, it is determined that the movement of the LED 10 does not correspond to the double-click movement because the movement of the LED 10 is not stationary, and the process proceeds to step 308, where the timer T1 is reset. Return to the standby state.
[0183]
If it is determined in step 302 that T1 ≧ Tth, it is determined that the LED 10 is in a state of being stationary for a predetermined time, and thus it is determined that the LED 10 corresponds to a double-click movement. Perform processing.
[0184]
After step 306, the process proceeds to step 308, resets the timer T1, and returns to the standby state.
[0185]
As described above, since the movement of the LED 10 is determined using the time including the stationary state for a predetermined time in the predetermined movement, the processing amount of the personal computer 30 is reduced, and the LED 10 Can judge the movement. The operation of the instruction input person becomes relatively easy.
[0186]
[Fifth Embodiment]
In the fourth embodiment, the example in which the movement of the double click is determined based on the time has been described. In the present embodiment, not only the double click but also the movement of the click is determined based on the time. Will be described.
[0187]
The configuration of the instruction input processing system of the present embodiment is the same as that of the first embodiment, and a description thereof will be omitted.
[0188]
Here, an example will be described in which an icon is displayed on the display 42 and the icon is designated as a processing target. In addition, the click movement is set as a state of being stationary for a predetermined time, and the double-click movement is set as a state of being still for a predetermined time after the click movement. A state in which the LED 10 moves slowly after the movement of the LED 10 is determined to be a click movement is set as a drag movement. Further, a state in which a predetermined acceleration and speed are generated during the drag process is set as a drop motion.
[0189]
Note that the threshold value of the stationary time can be arbitrarily set.
[0190]
FIG. 13 is a flowchart showing a main routine of the instruction input process performed by the CPU 34 of the personal computer 30.
[0191]
In step 400, it is determined whether or not the designated position of the cursor matches the display position of the icon. If it is determined that they do not match, the process returns to the standby state. When it is determined that they match, the process proceeds to step 402, and after determining that they match, it is determined whether or not a predetermined time has elapsed without moving the cursor position.
[0192]
If a negative determination is made in step 402, the process returns to the standby state.
[0193]
If an affirmative determination is made in step 402, the movement of the LED 10 corresponds to the click movement.
[0194]
In step 406, it is determined whether or not the display position of the cursor at the time of the click processing (here, the same as the designated position) matches the current display position of the cursor.
[0195]
If an affirmative determination is made in step 406, it is determined in step 408 whether a predetermined time has elapsed. If a negative determination is made in step 408, the process returns to step 406. If an affirmative determination is made in step 408, the state is still for a predetermined period of time after the movement of the click, and the movement of the LED 10 corresponds to the movement of the double click.
[0196]
On the other hand, if it is determined in step 406 that the display position of the cursor at the time of the click processing does not match the current display position of the cursor, the process proceeds to step 412, where the absolute value of the detected speed (here, z (In either the plus direction or the minus direction on the axis) ₀ It is determined whether it is less than.
[0197]
At step 412, speed <V ₀ If it is determined that the LED is moving, the process moves to step 414 and the drag process is performed because the LED 10 is moving slowly.
[0198]
Next, in step 416, the acceleration is set to the threshold value A. ₀ It is determined whether or not it has exceeded.
[0199]
At step 416, acceleration ≦ A ₀ If it is determined that the state is “1”, the state in which the LED 10 is moving slowly is continued, and the process returns to step 414 to continue the drag process.
[0200]
In step 416, acceleration> A ₀ If it is determined that the speed is equal to or less than the threshold V ₀ It is determined whether or not it has exceeded.
[0201]
At step 418, speed ≦ V ₀ If it is determined that the state is “1”, the state in which the LED 10 is moving slowly is continued, and the process returns to step 414 to continue the drag process.
[0202]
In step 418, speed> V ₀ If it is determined that the movement of the LED 10 corresponds to the movement of the drop, the process proceeds to step 420 to perform the drop processing.
[0203]
If it is determined in step 412 that the speed is equal to or greater than V0, the operation of the LED 10 does not correspond to any of the operations, and the process ends without performing any operation.
[0204]
As described above, when the cursor displayed by the movement of the LED 10 is displayed at the same position for a predetermined time (when it is stationary), the icon at that position is selected or opened. It is possible.
[0205]
In the present embodiment, the judgment on the allowable range of the x and y coordinate values is omitted, but in the present embodiment, an allowable range is provided similarly to the second embodiment, and the position of the LED 10 is changed. If is within the allowable range, it may be determined in step 406 that the display position of the cursor at the time of the click processing matches the current display position of the cursor (that is, the cursor is stationary).
[0206]
At this time, it is also preferable to set the allowable range of the change (x, y coordinate values) of the display position of the cursor to, for example, (± 5 × 3/100 mm). Further, in the present embodiment, an example in which the speed is used to determine the movement of the drag has been described. However, the allowable range for determining the movement of the click or the double click is the first allowable range, and the movement of the drag is determined. A second permissible range (a range wider than the first permissible range) for determination is provided separately from the first permissible range, and the cursor moves beyond the first permissible range to be within the second permissible range. If the state remains for a predetermined period of time, it may be determined that the movement is a drag movement.
[0207]
It is also preferable to start dragging when the z-coordinate value of the LED 10 moves in a direction in which the z-coordinate value decreases within a predetermined time, that is, when the LED 10 moves in a direction approaching the 3D measurement device.
[0208]
As described above, it is also possible to configure an algorithm in the order of time, acceleration, and speed (or only time).
[0209]
Thereby, the processing amount of the personal computer 30 is reduced, and the movement of the LED 10 can be easily determined. The operation of the instruction input person becomes relatively easy.
[0210]
[Sixth Embodiment]
In the present embodiment, time-series information (hereinafter, referred to as a time-series pattern) of a three-dimensional position indicating a movement such as a click or a double-click is stored in the HDD 46 or the ROM 36, and the time-series pattern is used. Next, an example of determining the movement of the LED 10 will be described. The configuration of the instruction input processing system of the present embodiment is also the same as that of the first embodiment, and a description thereof will be omitted.
[0211]
The command generation unit 50 inputs the three-dimensional position information measured from the 3D measurement device 20 at predetermined time intervals. The command generation unit 50 sequentially stores the input position information in a predetermined area of the RAM 38 to obtain time-series position information of the LED 10.
[0212]
The area for storing the input position information may have, for example, a ring-shaped data structure. The newly input three-dimensional position information is overwritten on the area storing the oldest data in the ring-shaped storage area.
[0213]
FIG. 14 is a flowchart showing a processing routine for storing position information, which is performed every predetermined time.
[0214]
In step 500, three-dimensional position information is acquired from the 3D measuring device 20.
[0215]
In step 502, the acquired three-dimensional position information is overwritten on the area in the RAM 38 where the oldest data is stored.
[0216]
Thereby, time-series data of the three-dimensional position information is obtained.
[0219]
FIG. 15 is a flowchart showing an instruction input processing routine for performing instruction input processing using a time-series pattern, which is performed at predetermined time intervals. The program of this instruction input processing routine is stored in a storage medium such as the HDD 46 and executed by the CPU 34 as in the first embodiment.
[0218]
In step 600, time-series three-dimensional position information from the current time to a time before a predetermined time Ta is fetched from the RAM.
[0219]
In step 602, p is set to 0. p is a counter for sequentially matching all the time-series patterns stored in advance with the trajectory represented by the acquired position information.
[0220]
In step 604, p is incremented.
[0221]
In step 606, the stored p-th time-series pattern is matched with the trajectory represented by the acquired position information.
[0222]
Here, an example of a time-series pattern that is stored in advance is shown in FIGS. 16 and 17.
[0223]
FIG. 16 is an example of a time-series pattern showing a click movement, and FIG. 17 is an example of a time-series pattern showing a double-click movement. In the present embodiment, for example, these time-series patterns are matched with a previously acquired trajectory pattern to determine which time-series pattern the movement of the LED 10 corresponds to.
[0224]
In step 608, the matching result is stored in a predetermined area of the RAM 38.
[0225]
For example, the similarity may be converted into a numerical value by using a method such as scaling or the least squares method, and this may be stored as a matching result with the p-th time-series pattern.
[0226]
In step 610, the counter p and the total number p of the time series patterns stored in advance are set. ₀ And p> p ₀ Is determined. p ≦ p ₀ If it is determined that is, the process returns to step 604, and the process of incrementing p and matching the next time-series pattern with the trajectory represented by the captured position information is repeated.
[0227]
In step 610, p> p ₀ When it is determined that the matching is completed, the matching between the trajectory represented by the acquired position information and all the time-series patterns is completed. Select
[0228]
Next, in step 614, a local maximum value and a local minimum value are determined from the acquired position information. Specifically, if the selected time-series pattern is a time-series pattern indicating a click movement, one maximum value and one minimum value are determined. If the selected time-series pattern is a time-series pattern indicating a double-click movement, one maximum value and two minimum values are determined.
[0229]
In step 616, time-series position information is divided based on the local maximum value and the local minimum value. For example, if the movement of the LED 10 is the movement shown in FIG. 8, the time-series position information is divided into four from the two minimum values and one maximum value of the z coordinate value. That is, the data is divided into four pieces of data from point B4 to point B3, point B3 to point B2, point B2 to point B1, and point B1 to the end of the time-series position information.
[0230]
In step 618, the speed and the acceleration are calculated for each of the divided data. The sign of the speed or the acceleration changes depending on the moving direction of the LED 10, but it is sufficient to see only the absolute value here.
[0231]
Various methods can be used for calculating the speed. As described in the first embodiment, the speed may be calculated by dividing the difference between the z-coordinate values of the divided data by the time difference. Is determined by calculating the difference between the z-coordinate value at an arbitrary time within the time frame and the z-coordinate value at a time shifted by the time frame from the time, and dividing by the time frame. You can also.
[0232]
The acceleration can be obtained, for example, as follows. A difference between continuous position information in the divided data is obtained to generate new time-series data. A frame Tm on an arbitrary time axis is provided for the generated time-series data, and time-series data at an arbitrary time within the frame Tm and time-series data at a time shifted from the time by the frame Tm are provided. When the difference is obtained and divided by the frame Tm, the acceleration is obtained.
[0233]
The method for obtaining the speed and acceleration is not particularly limited, and any method may be used.
[0234]
In step 620, the movement of the LED 10 is verified based on the obtained speed and acceleration.
[0235]
Specifically, it is determined whether or not each of the acceleration and the speed for each of the divided data exceeds a preset threshold. Here, if it is determined that at least one does not exceed the threshold, the verification result is NG. If it is determined that all the accelerations and velocities exceed the threshold, the verification result is OK.
[0236]
FIG. 18 shows an example of the state of the speed in the movement of the click, and FIG. 19 shows an example of the state of the speed in the movement of the double click. In this figure, the speed is represented by an absolute value. V shown ₀ Is the speed threshold. In addition, in order to make the points easy to understand, the speed is represented by a simple mountain shape.
[0237]
As shown in the drawing, if the speed of each of the two divided data exceeds the threshold value, the verification result is OK. In the double click, if each speed of the four divided data exceeds the threshold value, the verification result is OK.
[0238]
In step 622, it is determined whether the verification result is OK. When it is determined that the verification result is NG, the movement of the LED 10 does not correspond to the movement indicated by the selected time-series pattern, and thus the process ends.
[0239]
If it is determined in step 622 that the verification result is OK, the process proceeds to step 624 to instruct execution of a process associated with the motion indicated by the selected time-series pattern.
[0240]
It should be noted that the specific processing of step 624 is performed in each step (step 114, step 144, step 150, step 150, and step 150) of instructing the execution of the processing associated with the movement such as the click or the double click in the first embodiment. 156), and the description is omitted.
[0241]
For the divided data, the speed and acceleration are sequentially calculated for each of the divided data and compared with the threshold. If it is determined that the threshold has not been exceeded for a certain divided data, the speed and the acceleration for the remaining divided data are determined. The processing may be terminated immediately without calculating the acceleration.
[0242]
Further, the method of selecting the time-series pattern is not limited to the above-described example, and the following method can be adopted. For example, characteristics of a time-series pattern indicating a click or a double-click movement are stored in advance.
[0243]
For example, for a time-series pattern indicating a click movement, a feature that one minimum value exists in the z-coordinate value is stored in advance. In addition, as for the time-series pattern indicating the movement of the double click, the feature that two consecutive local minimum values exist in the z coordinate value is stored.
[0244]
Thereby, it is determined whether or not the trajectory represented by the acquired position information has the characteristic, and matching is performed. Specifically, when it is determined that only one local minimum exists in the trajectory represented by the captured time-series position information, a time-series pattern indicating a click movement is selected, and two consecutive patterns are displayed. If it is determined that a local minimum exists, a time-series pattern indicating a double-click movement can be selected.
[0245]
As described above, since the movement of the LED 10 is determined using the time-series pattern in addition to the speed and the acceleration, the movement can be determined with higher accuracy.
[0246]
[Seventh Embodiment]
In the present embodiment, an example will be described in which the movement of the LED 10 is determined only by the time-series pattern without performing the processing for calculating and verifying the speed and the acceleration. The configuration of the instruction input processing system of the present embodiment is also the same as that of the first embodiment, and a description thereof will be omitted.
[0247]
Here, an area in which the 3D measuring device 20 recognizes light emission of the LED 10 is defined as a rectangular parallelepiped on the front surface of the 3D measuring device 20.
[0248]
FIG. 20 shows an example of a time-series pattern. From the vicinity (F) of the recognition area defined as a rectangular parallelepiped on the front surface of the 3D measuring device 20, the upper surface (E) of the rectangular parallelepiped, or the left surface or the right surface , And moves to the non-recognition area (G).
[0249]
Such a time-series pattern has the following features.
[0250]
The change in the time-series data of the x, y, and z coordinate values is a monotonous change. Since the LED 10 moves out of the recognition area, a state occurs in which the 3D measurement device 20 cannot recognize.
[0251]
Therefore, when the LED 10 shows a movement having such characteristics, it can be determined that the movement corresponds to this time-series pattern.
[0252]
When the time series pattern is recognized, for example, the present system may be shut down.
[0253]
FIG. 21 is also an example of a time-series pattern, and shows a movement in which the LED 10 is temporarily stopped in the recognition area, and thereafter, an arc is drawn in the recognition area.
[0254]
This arc-drawing motion (eg, clockwise, moving from bottom to top, and back again) has the characteristic that the next stop position is within a predetermined allowable range from the first pause position. .
[0255]
Further, the upper left corner toward the 3D measuring device 20 is defined as 0 as the origin, the x axis is defined as the + direction from the origin, the y axis is defined as the + direction, and the z axis is defined as the + direction as the forward direction. When the x, y, z coordinate system is defined by the following, the following features are provided.
[0256]
The x-coordinate value between the two stop positions changes so as to be monotonically decreasing, extremely small, and monotonically increasing.
[0257]
The y-coordinate value between the two stop positions changes to be monotonically decreasing, minimal, monotonically increasing, maximal, monotonically decreasing.
[0258]
Therefore, if the x-coordinate value and the y-coordinate value simultaneously satisfy these characteristics in this section, it can be determined that the time-series pattern is applicable. When the time-series pattern is recognized, for example, a process of enlarging and displaying the entire screen of the display may be executed.
[0259]
Further, in order to instruct execution of the process of restoring the display, a time-series pattern in which the drawing direction of the arc is counterclockwise may be separately set. Further, each time the arc is rotated, the display may be changed at a predetermined enlargement ratio and reduction ratio. Further, the movement of the arc may be a movement on the xz-axis plane instead of the movement on the xy-axis plane.
[0260]
Note that when drawing an arc in the air, it is relatively difficult to return the hand to the exact same position again from the first stop position, so that the first stop position and the next stop position are provided with an allowable range as appropriate. It is preferred to do so.
[0261]
[Eighth Embodiment]
In the present embodiment, an example will be described in which the display state of the cursor is changed or the sound is generated based on the speed so that the instruction input person can recognize the state of the movement of the LED 10.
[0262]
In the present embodiment, an extended cursor is displayed separately from a general cursor.
[0263]
Here, the extended cursor will be described. On the desktop displayed on the display 42 of the personal computer 30, a small area including a point at which a general cursor designates an object (corresponding to the designated position described above) is surrounded by an arc or the like and displayed again as a small window. is there.
[0264]
As shown in FIGS. 22A and 22B, the inside of a circle centered on the designated position 30 is displayed in a small window (extended cursor) 72. The general cursor 74 is displayed so as to be superimposed on the inside of the extended cursor 72, particularly at the center. The extended cursor 32 is displayed by the OS 54 using the image driver 56.
[0265]
In the present embodiment, a processing routine shown in FIG. 23 is executed instead of the display processing routine described in the first embodiment. This routine is executed every predetermined time.
[0266]
In step 700, three-dimensional position information is fetched.
[0267]
At step 702, the speed is detected. Since the detection method is the same as that of the first embodiment, the description is omitted here.
[0268]
At step 704, it is determined whether or not the detected speed Vk has exceeded a preset threshold value Vth. If an affirmative determination is made here, the process proceeds to step 706, where the size of the extended cursor 72 is enlarged. Further, in step 708, the enlargement ratio of the image in the extended cursor 72 is increased according to the detected speed Vk. Further, in step 710, a sound corresponding to the speed is generated from the speaker 44.
[0269]
FIG. 22A shows a state where the size of the extension cursor 72 is enlarged and the enlargement ratio of the image in the extension cursor 72 is increased.
[0270]
In step 712, the display positions of the cursor 74 and the extended cursor 72 are moved according to the three-dimensional position information.
[0271]
On the other hand, if a negative determination is made in step 704, the process moves to step 712, where only cursor movement processing is performed.
[0272]
FIG. 22B shows a state of the extended cursor when the speed is not sufficient. As shown in the figure, the radius of the extended cursor 72 is minimum, and the image in the circle is the same as the background, that is, the magnification is 1.
[0273]
As described above, when the speed of the extended cursor 72 is not sufficient, the extended cursor 72 is displayed in a small size, and as the speed increases, the size is increased. It can be moved, and instruction input becomes easy.
[0274]
It is also possible to control so that the extended cursor 72 is not always displayed, but is displayed if the speed is higher than a predetermined value, and is not displayed if the speed is extremely reduced. Conversely, it is also possible to display when the speed is lower than a predetermined value, and not to display when the speed is extremely increased.
[0275]
In addition, as described in step 710, generating a unique sound in accordance with the speed assists the operation of the instruction input person, and is suitable for the visually impaired. This allows the instruction input person to recognize how fast the hand should be moved.
[0276]
Further, the color such as the hue of the cursor 74 or the extended cursor 72 can be changed according to the speed. Further, it is also possible to allow the instruction input user to arbitrarily set the change of the display state and the size (for example, radius or the like) of the extended cursor.
[0277]
As described above, as described in each embodiment, the movement of the LED 10 is determined based on the speed and the acceleration accompanying the movement of the LED 10. Regardless of the distance from the measurement device 20, operations such as click, double-click, and drag can be performed without using a mechanical mechanism.
[0278]
Further, the present invention is not limited to the above-described embodiment, and can be applied not only to the operation of a personal computer but also to the operation of a touch panel such as a copier or an ATM of a financial institution. Thereby, the operation of the touch panel can be performed without touching the screen.
[0279]
Further, the present invention can be applied to ON / OFF operation of a switch.
[0280]
【The invention's effect】
The present invention determines whether or not the movement of the light emitting unit corresponds to a predetermined movement based on a physical quantity related to the speed accompanying the movement of the light emitting unit, and determines that the movement of the light emitting unit corresponds to the predetermined movement. In this case, the user is instructed to execute a process associated with the predetermined motion, so that there is an effect that an instruction can be input without requiring a mechanical operation or a relatively fine operation.
[Brief description of the drawings]
FIG. 1 is a diagram illustrating a configuration of an instruction input system including a personal computer having a function as an instruction input device according to a first embodiment of the present invention.
FIG. 2 is a diagram showing a specific configuration of a personal computer.
FIG. 3 is a diagram functionally showing a configuration of a personal computer main body.
FIG. 4 is a diagram specifically showing an example of each of click, double-click, and drag-and-drop instruction operations.
FIG. 5 is a flowchart showing a main routine of an instruction input process performed by a CPU of the personal computer.
FIG. 6 is a flowchart showing a main routine of an instruction input process performed by a CPU of a personal computer.
FIG. 7 is a flowchart illustrating a main routine of an instruction input process performed by a CPU of the personal computer.
FIG. 8 is a diagram illustrating an example of the movement of an LED corresponding to the movement of a double click.
FIG. 9 is a flowchart illustrating a display processing routine.
FIG. 10 is a flowchart illustrating a part of a main routine of an instruction input process according to the second embodiment.
FIG. 11 is a flowchart illustrating a processing routine for determining whether or not to lock a position according to a process being executed in the third embodiment;
FIG. 12 is a flowchart illustrating a part of a main routine of an instruction input process according to the fourth embodiment.
FIG. 13 is a flowchart illustrating a main routine of an instruction input process according to the fifth embodiment.
FIG. 14 is a flowchart illustrating a processing routine for storing position information according to a sixth embodiment.
FIG. 15 is a flowchart illustrating an instruction input processing routine for performing instruction input processing using a time-series pattern according to the sixth embodiment.
FIG. 16 is an example of a time-series pattern showing a click movement.
FIG. 17 is an example of a time-series pattern showing a double-click movement.
FIG. 18 is a diagram illustrating an example of a speed state in a click movement.
FIG. 19 is a diagram illustrating an example of a speed state in a double-click movement.
FIG. 20 is an example of a time-series pattern according to the seventh embodiment.
FIG. 21 is an example of a time-series pattern according to the seventh embodiment.
FIG. 22A is a diagram showing a state where the size of the extension cursor is enlarged and the enlargement ratio of an image in the extension cursor is increased. FIG. 22B shows a case where the speed is not sufficient. 5 is a diagram showing a state of an extended cursor of FIG.
FIG. 23 is a flowchart showing a processing routine according to the eighth embodiment.
[Explanation of symbols]
10 LED
20 3D measuring device
30 PC
34 CPU
36 ROM
38 RAM
40 I / O
42 Display
44 Speaker
46 HDD
50 Command generator

Claims (24)

Input means for inputting position information of the light emitting means measured based on a light receiving state of light emitted from the light emitting means which can be worn by the instruction input person;
Based on the input position information, detecting means for detecting a physical quantity related to the speed accompanying the movement of the light emitting means,
Determining means for determining whether or not the movement of the light emitting means corresponds to a predetermined movement based on the detected physical quantity relating to the speed;
Instructing means for instructing execution of a process associated with the predetermined movement, when it is determined that the movement of the light emitting means corresponds to a predetermined movement,
An instruction input device including: Comprising storage means for storing movement information indicating a plurality of different predetermined movements,
The determining means includes:
Selecting means for selecting at least one piece of motion information corresponding to the motion of the light emitting means from the plurality of stored pieces of motion information;
Verification means for verifying whether or not the movement of the light emitting means corresponds to the movement indicated by the movement information selected by the selection means,
The instruction input device according to claim 1, further comprising: The motion information is time-series information of a position,
The input means inputs the position information in time series,
The instruction input device according to claim 2, wherein the selection unit selects the at least one piece of motion information based on the position information input in a time series. 3. The method according to claim 2, wherein the verification unit verifies whether or not the movement of the light emitting unit corresponds to the movement indicated by the movement information selected by the selection unit based on the detected physical quantity related to the speed. Item 3. The instruction input device according to Item 3. The instruction input device according to any one of claims 1 to 4, wherein the physical quantity related to the speed is at least one of an acceleration and a speed associated with a movement of the light emitting unit. Display means for displaying target information for which execution of processing is instructed, and designation information for designating the target information;
Display control means for controlling the display means such that the position of the designated information changes in response to the change of the input position information,
Further comprising
The instruction means, when it is determined that the movement of the light emitting means corresponds to a predetermined movement, for the target information designated by the designation information, a process associated with the predetermined movement The instruction input device according to any one of claims 1 to 5, which instructs execution. The instructing means may correspond to the predetermined movement for the target information designated by the designation information, among the movements of the light emitting means determined to correspond to the movement of the light emitting means. 7. The instruction input device according to claim 6, which instructs execution of the attached processing. The instruction input device according to any one of claims 1 to 7, wherein the predetermined movement is a movement that makes one reciprocation in a predetermined direction. The predetermined motion is a motion that makes one reciprocation in a predetermined direction within a predetermined time,
Comprising calculating means for calculating the time accompanying the movement of the light emitting means,
9. The method according to claim 8, wherein the determining unit determines whether the movement of the light emitting unit is the predetermined movement based on the detected physical quantity relating to the speed and the time calculated by the calculating unit. Instruction input device. The instruction input device according to any one of claims 1 to 7, wherein the predetermined movement is a movement that reciprocates two times in a predetermined direction. The predetermined motion is a motion of reciprocating two times in a predetermined direction within a predetermined time,
Comprising calculating means for calculating the time accompanying the movement of the light emitting means,
The method according to claim 10, wherein the determining unit determines whether the movement of the light emitting unit is the predetermined movement based on a physical quantity related to the detected speed and a time calculated by the calculating unit. Instruction input device. The predetermined movement is to move in a predetermined direction, move in the predetermined direction, and further move in the predetermined direction, a direction orthogonal to the predetermined direction, or a direction sandwiched by both directions. The instruction input device according to any one of claims 1 to 7, wherein the instruction is a movement. The predetermined movement is to move in a predetermined direction, and after moving in the predetermined direction, after a predetermined time has elapsed, further move in the predetermined direction, a direction orthogonal to the predetermined direction, or both directions. It is a movement that moves in the direction between
Comprising calculating means for calculating the time accompanying the movement of the light emitting means,
13. The method according to claim 12, wherein the determination unit determines whether the movement of the light emitting unit is the predetermined movement based on a physical quantity related to the detected speed and a time calculated by the calculation unit. Instruction input device. The instruction input device according to claim 1, wherein the predetermined movement is a movement that moves in a direction opposite to a predetermined direction. The instruction input device according to claim 1, wherein the predetermined movement is a stationary state. The predetermined movement is a state in which the predetermined movement is stationary for a predetermined time,
Comprising calculating means for calculating the time accompanying the movement of the light emitting means,
The determining means determines whether or not the movement of the light emitting means is in a stationary state for the predetermined time based on the physical quantity relating to the detected speed and the time calculated by the calculating means. The instruction input device according to claim 15. Comprising calculating means for calculating the time accompanying the movement of the light emitting means,
8. The method according to claim 1, wherein the determining unit determines whether the movement of the light emitting unit corresponds to a predetermined movement based on the detected physical quantity related to the speed and the calculated time. The instruction input device according to any one of the preceding claims. 2. The method according to claim 1, wherein the determining unit determines whether the movement of the light emitting unit corresponds to a predetermined movement by giving an allowable amount to the movement of the light emitting unit or the predetermined movement. The instruction input device according to claim 17. 19. The instruction input device according to claim 6, wherein the display control unit controls to change a display state of the instruction information based on a physical quantity related to the detected speed. 20. The instruction input device according to claim 19, wherein the display control unit controls to change at least one of a shape, a size, and a color of the instruction information based on a physical quantity related to the detected speed. 21. The instruction input device according to claim 20, wherein the display control unit controls to change a size of target information displayed within a predetermined distance from a position of the designated information. Sounding means for outputting voice;
Sound output control means for controlling the sounding means so as to change a sounding state based on the physical quantity relating to the detected speed,
The instruction input device according to any one of claims 1 to 21, further comprising: A measuring step of measuring position information of the light emitting means based on a light receiving state of light emitted from the light emitting means that can be worn by the instruction input person,
An input step of inputting the position information measured in the measurement step,
Based on the input position information, a detection step of detecting a physical quantity related to the speed accompanying the movement of the light emitting unit,
A determining step of determining whether or not the movement of the light emitting unit corresponds to a predetermined movement based on the detected physical quantity related to the speed;
An instruction step of instructing execution of a process associated with the predetermined movement when it is determined that the movement of the light emitting unit corresponds to a predetermined movement;
Instruction input method including. On the computer,
An input step of inputting position information of the light emitting unit measured based on a light receiving state of light emitted from the light emitting unit that can be worn by the instruction input person;
Based on the input position information, a detection step of detecting a physical quantity related to the speed accompanying the movement of the light emitting unit,
A determining step of determining whether or not the movement of the light emitting unit corresponds to a predetermined movement based on the detected physical quantity related to the speed;
An instruction step of instructing execution of a process associated with the predetermined movement when it is determined that the movement of the light emitting unit corresponds to a predetermined movement;
The program to execute.

Images