TWI411940B - Instruction device and method - Google Patents

Abstract

An instruction device is provided for communicating an instruction to an icon in an image area, and includes a motion sensing unit and a processing unit. The motion sensing unit senses a first motion and generates a corresponding first signal. The processing unit generates a first locus in response to the corresponding first signal, and determines a first area in the image area according to the first locus for a decision whether the icon shall be or has been selected according to a relationship between the first area and a second area where the icon is to be displayed in the image area.

Description

Command device and method

The present invention relates to an instruction device and method, and more particularly to an apparatus and method for issuing an instruction to an image icon.

For a long time, the two-dimensional (2D) mouse that is used for motion on the desktop is generally operated by positioning the indicator on the computer screen (Cursor) to the icon (Icon) to be executed, and then continuously sliding. Left mouse button twice to perform the icon function. Please refer to the first figure (a) and (b) a schematic configuration diagram of the conventional icon selection system, which is a schematic diagram of the selected configurations 911 and 912 of the conventional icon selection system 91. As shown in the first diagram (a), the selection configuration 911 includes a display system S91, a display area A91, a cursor C91 and a mouse M91. The complex icons I1, I2, I3, I4, I5, and I6 are displayed in the display area A91. As for the mouse M91, it can be a two-dimensional (2D) plane mouse or a three-dimensional (3D) aerial mouse. As shown in the figure, the conventional mouse M91 moves on the operation of the selected icon I2, and its movement purpose is to move the cursor C91 to the icon I2 to be selected, so the motion type is to make the cursor C91 perform X or Y. One-way motion, or line motion in the X and Y directions.

As shown in the first figure (b), the cursor C91 in the configuration 912 is selected to select the icon I1, and the movement path GA of the cursor C91 is generally, for example, by line segments A1, A2, A3, A4, A5, A6, A7, and A8 are combined.

Recently, due to the MEMS type accelerometer (Accelerom _e ter/G-sensor), the gyroscope and the geomagnetic instrument (e-Compass) are more convenient to use, so that the hand is sensed in the air to The so-called three-dimensional mouse that selects the icon of the computer screen and performs its function is gradually developed. However, these three-dimensional mice have a major difference in operation compared to the conventional two-dimensional mouse used on the desktop. Because the two-dimensional mouse moves on the table, it is often supported by the desktop. In this case, when the icon on the screen is selected and the button is pressed continuously by the finger to perform the function of the icon, the mouse does not move and the cursor on the screen deviates from the icon. However, when the handheld three-dimensional mouse is operated in the air, there is no other support, so that when the button is pressed continuously by the finger to perform the icon function, it is easy to cause the cursor on the screen to deviate from the selected one due to the movement of the hand. Icon, which causes errors in the execution of operations, such as Logitech's product Air Mouse has this problem.

In order to overcome the above problems, some companies related to the 3D mouse / Air Mouse products, such as the Gyration, have designed an Active Button to improve the movement of the cursor. Its practice is that when the three-dimensional mouse moves in the air and the actuation button is also pressed, the cursor on the screen will move with the movement of the mouse; when the cursor falls on the icon, and the actuation button is released After that, the cursor no longer moves with the movement of the mouse; at this time, pressing the button to execute the icon function, even if the mouse moves, but since the cursor on the screen has been disconnected from the movement of the mouse, The indicator will be positioned on the icon, allowing it to perform the function successfully. In addition, Hillcrest, another supplier on the market, has similar operating buttons on its Air Mouse-like product, Freespace, but it has the opposite function of the Active button of Gyration, that is, it does not need to press the Active button. The motion of the cursor can be controlled by motion. When the icon is selected and the function is to be executed, a cursor fixed button is pressed to fix the cursor on the selected icon, and then the left mouse button is pressed twice consecutively. To perform the icon function. Although these two modes of operation can make the operation of the icon function be true, but this kind of operation behavior is to release the Active button or press the cursor fixed button operation moment, still need to concentrate, be careful, no deviation action Let the cursor drift. Therefore, these operations are indeed contrary to the ergonomic exercise that relaxes nature and keeps it easy, that is, the above operations are not only intermittent and not comfortable, and indeed uncomfortable.

However, in order to overcome the above-mentioned deficiencies of the prior art, the following is cited as a reference to the present invention, and the same as the TW097130594 Taiwan invention patent application "selection device and method" proposed by the inventor of the present invention technology.

As shown in the second diagram (a), the system architecture 921 of the selection apparatus of the present invention is shown in the prior art. The selection unit U92 is configured to have a motion F21, the conversion motion F21 is a trajectory G21, and the display system S92 is determined according to the trajectory G21. A region H21 in the upper display area A92, and an area K21 displayed in the display area A92 according to the area H21 and the icon I1, determines whether the icon I1 is selected.

The selection unit U92 can include a motion sensing unit SS92 and a processing unit P92. The motion sensing unit SS92 converts the motion F21 to the signal S1. The processing unit P92 converts the signal S1 to the track G21. The previous case is based on another specific relationship of a region H21 determined by the trajectory G21 with respect to the region K21 by a microprocessor P921 to determine whether the icon I1 is selected.

The prior art, which is also described by the inventors of the present invention for the icon selection operation by the inductive motion mapping trajectory, enables the three-dimensionally operated mouse of the Air mouse category to select and display efficiently and simply. The icon on the PC screen and perform its functions.

Moreover, however, the present invention is to effectively extend this type of operation to more diverse and complex, such as different sizes and shapes of the human-machine operation graphic interface of the home entertainment center. And the operation of the electronic menu of various function icons of the arrangement mode, and further improve the user's operation convenience, so that, for example, not only the icon selection operation, but also the electronic menu of the complicated human-machine graphical interface The selection operation is more intuitive, and allows the user to select various electronic menu options and perform their functions simply, accurately and efficiently.

In view of the above, the inventor of the present invention, in view of the above-mentioned prior art foundation, and after careful research, and a perseverance spirit, finally invented the "instruction device and method" of the case.

One of the purposes of this case is to mirror a trajectory by motion, and to circle an area, or to form another geometric pattern trajectory, or to form a geometric line, and to make the area, or the geometric trajectory or The geometric line has an intersection relationship with the area where the icon to be selected or its area or its area has an intersection, a pass, or a cover, thereby selecting an icon. After the icon is selected, it is continuously ticked, crossed, or circled again, or other arm and wrist motions to enable a preset function of the icon to be executed. The implementation of this icon selection is ergonomic, the operation is smooth and complete, and it is done in one go.

The first concept of the present invention is to provide an instruction device for transmitting an icon in an image area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding one. And a processing unit, generating a first track according to the first signal, and defining a first area in the image area, and displaying the image in the image area according to the first area and the icon A relationship between a second region to determine whether the icon is or has been selected.

The second concept of the present invention is to provide an instruction device for transmitting an icon in an image area, comprising a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals And a processing unit, generating a first track according to the first signal, and defining a first area in the image area, and according to the first area and at least another icon of the icon and the surrounding area And a total of at least two icons displayed in a relationship of a second region in the image region to determine whether the icon is to be selected.

The third concept of the present invention is to provide an instruction device for transmitting a command medium in a specific area, which includes a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals. And a corresponding device, generating at least three reference positions corresponding to the first signal, and defining one of the first regions in the specific region, and according to the first region and the reaction medium in the specific region A relationship in the second area for deciding whether to communicate the instruction to the reaction medium.

The fourth concept of the present invention is to provide an instruction device for transmitting a signal to a reaction medium in a specific area, comprising a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals And a corresponding device, corresponding to the first signal, generating at least three reference positions, and thereby defining one of the first regions in the specific region, and reacting according to the first region with at least one other of the reaction medium and the surrounding thereof The medium or the like has a relationship of at least two reaction media in a second region of the particular region for determining whether to convey the instruction to the reaction medium.

The fifth concept of the present invention is to provide an instruction device for transmitting a signal to a reaction medium in a specific area, comprising a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals And a corresponding device, corresponding to the first signal, generating at least three reference positions, and defining one of the first regions in the specific region, and according to the first region and the reaction medium in the specific region A relationship between the two regions for deciding whether or not to convey the instruction to the reaction medium.

The sixth concept of the present invention is to provide an instruction device for transmitting a response medium in a specific area, which includes a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals. And a corresponding device, corresponding to the first signal to generate at least two reference positions, and according to the relationship between the at least two reference positions and the reaction medium, for the reaction medium to determine whether to operate.

The seventh concept of the present invention is to provide an instruction device for conveying an instruction to a reaction medium, comprising an instruction unit configured to transmit a command medium, and accordingly generate at least two reference positions, and according to the at least two reference The position is related to one of the reaction media for the reaction medium to determine whether to act.

The eighth concept of the present invention is to propose an instruction communication method for providing at least two reference positions in response to a first instruction medium by using the following instructions in a reaction medium, and at least two reference positions and the reaction medium One of the relationships for the reaction medium to decide whether to act.

The ninth concept of the present invention is to provide an instruction device for transmitting a command medium in a specific area, which includes a sensing unit, sensing a first command medium, and generating a corresponding one of the first signals. And a corresponding device corresponding to the first signal to generate two reference positions to form a geometric line, and according to the relationship between the geometric line and the reaction medium, for deciding whether to convey the instruction to the reaction medium.

The tenth concept of the present invention is to provide an instruction device for transmitting a signal to a reaction medium in a specific area, comprising a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals And a corresponding device, temporarily generating a reference position corresponding to the first signal, and determining whether to transmit the instruction to the reaction medium according to the relationship between the reference position and the reaction medium.

The eleventh concept of the present invention is to provide an instruction device for transmitting an instruction to a reaction medium, comprising a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding The device temporarily provides a reference position corresponding to the first signal and determines whether to communicate the instruction to the reaction medium based on the relationship between the reference position and the reaction medium.

The twelfth concept of the present invention is to provide an instruction device for transmitting an instruction to a reaction medium, comprising a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding The device temporarily generates a reference signal corresponding to the first signal and determines whether to communicate the instruction to the reaction medium based on the relationship between the reference signal and the reaction medium.

The thirteenth concept of the present invention is to provide an instruction device for transmitting an instruction to a reaction medium, comprising a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding The device temporarily generates a reference parameter corresponding to the first signal, and according to the relationship between the reference parameter and the reaction medium, for the reaction medium to determine whether to operate.

The fourteenth concept of the present invention is to provide an instruction device for conveying an instruction to a reaction medium, comprising an instruction unit configured to transmit a command medium, and to temporarily generate a reference parameter, and according to the reference parameter It is related to one of the reaction media for the reaction medium to determine whether to operate.

The fifteenth concept of the present invention is to propose an instruction communication method for temporarily providing a reference parameter in response to a first instruction medium by using the following instruction in a reaction medium, and the following steps; and referring to the parameter and the reaction medium One of the relationships for the reaction medium to decide whether to act.

The sixteenth aspect of the present invention is to provide an instruction device for transmitting an instruction in an image area, wherein the image includes an instruction unit configured to perform a first motion to convert the first motion into a a first track, and determining a first region of the image region, and according to a relationship between the first region and a second region of the icon displayed in the image region, for determining whether to convey the instruction In the icon.

The seventeenth aspect of the present invention is to provide an instruction device for conveying a command medium in a specific area, comprising an instruction unit configured to perform a first motion to convert the first motion into a a first track, and determining a first region of the image region, and displaying a second region in the specific region according to the first region and the reaction medium for deciding whether to convey the instruction to the reaction medium.

The eighteenth aspect of the present invention is to provide an instruction device for conveying an instruction medium in a specific area, comprising an instruction unit configured to transmit a command medium and temporarily providing a reference position. And determining whether to communicate the instruction to the reaction medium based on the relationship between the reference position and the reaction medium.

The nineteenth concept of the present invention is to provide an instruction device for conveying an instruction to a reaction medium, comprising an instruction unit configured to transmit a command medium and to temporarily generate a reference signal, and according to the reference signal A relationship with one of the reaction media for determining whether to communicate the instruction to the reaction medium.

The twentieth concept of the present invention is to provide a command communication method for converting an icon into a first track by using one of the following instructions in an image region, and determining a first track according to the first track. a first region in the image region; and a relationship between the first region and the second region of the image region displayed in the image region for determining whether to transmit the instruction to the icon.

The twenty-first concept of the present invention is to propose an instruction communication method for generating a response medium by using one of the following instructions in a specific area, including the following steps, generating at least three reference positions in response to a first motion; Generating a first region; and determining whether to communicate the instruction to the reaction medium in response to the relationship between the first region and the second region of the reaction region displayed in the particular region.

The twenty-second concept of the present invention is to provide a method for transmitting instructions, using one of the following instructions for a reaction medium in a specific area, comprising the following steps, generating two reference positions in response to a first motion to form a geometric line; And determining whether the instruction is to convey the instruction to the reaction medium, as the geometric line is associated with one of the second regions of the particular region of the reaction medium.

The twenty-third concept of the present invention is to propose a method for transmitting instructions, using the following instruction to a reaction medium, including the following steps, temporarily generating a reference position in response to a first motion; and the reference position and the reaction medium A relationship between the decision to convey the instruction to the reaction medium.

The twenty-fourth concept of the present invention is to propose a method for transmitting instructions, using the following instruction to a reaction medium, including the following steps, temporarily providing a reference signal in response to a first instruction medium; and the reference signal and the response A relationship between the media to decide whether to convey the instruction to the reaction medium.

The twenty-fifth concept of the present invention is to provide an instruction device for transmitting an instruction to a first reaction medium, comprising: a first response unit, generating a signal in response to a command medium; and a second response unit, At least two position references are generated in response to the signal, and a relationship is determined between the first reaction medium and the at least two position reference for determining whether to communicate the instruction to the first reaction medium.

The twenty-sixth aspect of the present invention is to provide an instruction device for conveying an instruction to a first reaction medium, comprising: an instruction unit configured to send a command medium to generate at least two reference signals, and according to the at least The second reference signal is associated with one of the first reaction vectors for determining whether to communicate the instruction to the first reaction medium.

The twenty-seventh aspect of the present invention is to provide an instruction device for transmitting an instruction to a first reaction medium, comprising: a first response unit, generating a signal in response to a command medium; and a second response unit, Temporarily generating a set of a reference parameter, a position reference and a reference signal according to the signal, and according to the first reaction medium and from the reference parameter, the position reference and the selected one of the reference signals a relationship for deciding whether to convey the instruction to the first reaction medium.

The twenty-eighth concept of the present invention is to provide an instruction device for conveying an instruction to a first reaction medium, comprising: a notification unit, generating a corresponding signal according to a command medium; and a response unit, corresponding to Generating a set of a reference parameter, a position reference and a reference signal, and according to the first reaction medium and a relationship from the reference parameter, the position reference and the selected one of the reference signals, For deciding whether to convey the instruction to the first reaction medium.

- System architecture of the selection device of the present invention

Please refer to the second figure (b), which is a schematic diagram of the system architecture 922 and the operation mode of the first embodiment of the selection system. As shown, the selection system 922 includes a display system S92 and a selection device M92. A display device V92 on the display system S92 has a display area A92 on which an icon I1 is displayed. The selection means M92 includes a selection unit U92 for causing the icon I1 in the display area A92 to be selected.

In an embodiment, the motion sensing unit SS92 includes a gyroscope SS921, and the gyroscope SS921 senses the motion F21 to generate the signal S1. In an embodiment, the motion sensing unit SS92 includes an accelerometer SS922 that senses motion F21 to generate a signal S1. In an embodiment, the motion sensing unit SS92 includes an e-Compass SS923 that senses motion F21 to generate a signal S1. In an embodiment, the motion sensing unit SS92 includes a gyroscope SS921, an accelerometer SS922 and a geophone SS923; the gyroscope SS921 has at least two sensing degrees of freedom, and the motion F21 is sensed to generate the first portion of the signal S1. S11; the accelerometer SS922 has at least two degrees of freedom, sensing motion F21 to generate a second portion S12 of signal S1, and geomagnet SS 923 having at least two degrees of freedom, sensing motion F21 to produce a second signal S1 Part S13.

In addition, the processing unit P92 may include a controller P921, which may be a microcontroller (Microcontroller) or a microprocessor (Microprocessor) or a digital signal processor (Digital Signal Processor), or a A Field-Programmable Gate Array (FPGA) or a central processing unit (CPU).

- Embodiments of the basic operation concept and principle of selecting the motion corresponding trajectory of the system

The operation method of the selection device mentioned in this case is as shown in the second figure. In the second figure, the selection unit U92 is configured to have a motion F21, the transition motion F21 is a trajectory G21 on the display area A92, and according to the trajectory G21, a region H21 in the display area A92 is determined, and according to the area H21 and the icon I1 is displayed in a region K21 in the display area A92, determining whether the icon I1 is selected, and the area K21 is equivalent or not equivalent to the area H21.

The selection unit U92 can include a motion sensing unit SS92 and a processing unit P92. The motion sensing unit SS92 converts the motion F21 to the signal S1. The processing unit P92 converts the signal S1 to the track G21. Of course, whether or not the icon I1 is selected may be determined according to a specific relationship of the trajectory G21 itself with respect to the region K21 or another specific relationship of the region H21 with respect to the region K21 determined by G21. Embodiments of such specific relationships are detailed in subsequent paragraphs.

In addition, the movement F21 of the selection unit U92 may be formed by driving a selection unit by a hand (not shown), and the motion F21 may include at least one of a three-dimensional motion and a two-dimensional motion. The trajectory G21 on the display area A92 may be at least one of an arc, a complex arc, a curve, a complex curve, a line segment, and a plurality of line segments or a combination of the above various line types; and when the track G21 is the first circle In the case of an arc, the arc angle of the first arc may be equal to or greater than one of 180°, 360°, approximately 360°, and more than 360°.

Of course, the motion F21 sensed by the motion sensing unit SS92 can also be generated by a limb (not shown) such as a body part such as a hand, a foot, a head, a neck, a shoulder, or a waist.

- the way the icons are selected; there are six modes of operation

In the case of the selection method of the icon, the following six selection operation modes are proposed in this case. Among them, the operation method of directly selecting a single specific icon is described in the selection operation modes 1 to 4, and after selecting a plurality of icon candidates, and finally selecting a specific icon from among the candidates, The method is detailed in the selection of operating modes 5 and 6.

Select operation mode 1, please refer to the third figure, the operation of the instruction device and method of the present invention is selected as the operation mode. In FIG. 101, the user's hand movement (not shown), by means of the selection device M92 of the present invention, as shown in the second figure, corresponds to a track T1 displayed on the screen, as in the first embodiment. As shown in the operation diagram 101 of the figure, the track T1 includes a moving track segment MT1 and a selected track segment ST1. Wherein MT1 is a motion trajectory corresponding to the movement of the selection device M92 from a first spatial position relative to a previous reference point on the screen to a second spatial position relative to the starting point N11 of the selection trajectory ST1. . As for ST1, when the operation selecting means M92 circles the icon I1, the hand holds the selection trajectory corresponding to the movement of the selection means M92, and the selection trajectory has a selection starting point N11 and a selection end point N12. A comparison area IA1 (dashed-dotted line surrounding area) associated with the icon I1 surrounded by a region STA1 (dashed enclosing area) surrounded by the selected track ST1 is compared to determine whether the icon I1 is selected. The alignment condition here may be whether there is an intersection between the area of the area STA1 and the area IA1, that is, whether the areas of the two areas overlap partially, completely overlap, or completely cover, or the centroid of the area STA1 is located in the area IA1, Alternatively, when the centroid of the area IA1 is located in the area STA1, or when one of the track ST1 passes, the contact area IA1, or the like, the icon I1 is determined to be circled by the selecting means M92.

When the icon I1 is selected, as shown in FIG. 102, a geometric pattern associated with the selected track ST1, such as a circle G1 surrounding the periphery of the icon I1 or an inner circle G2 located inside the icon I1. It is displayed, indicating that this icon I1 has been circled. Next, the icon I1 will be displayed in discoloration or in reverse white, as shown in Fig. 103 as an anti-white icon I10 surrounded by an outer circle G1 or having an inner circle G2 inside. Thereafter, as shown in FIG. 104, G1 or G2 prompting the user to select the state will disappear, leaving a reversed icon I10 of the selection result.

Select the operation mode 2, please refer to the fourth figure, the operation diagram of the operation mode 2 of the icon selection instruction device and method proposed in the present case. In FIG. 201, the user's hand movement (not shown), by the selection device M92 of the present invention, as shown in the second figure, corresponds to a track T2 displayed on the screen, as in the second embodiment. As shown in the operation diagram 201 of the figure, the track T2 includes a moving track segment MT2 and a selected track segment ST2. Wherein MT2 is a movement of the selection device M92 from a first spatial position associated with a previous reference point (not shown) on the screen to a second spatial position associated with the starting point N21 of the selected trajectory ST2. The resulting trajectory. As for ST2, when the operation selecting means M92 circles the icon I1, the hand holds the selection track corresponding to the movement of the selection means M92, and the selection track has a selection starting point N21 and a selection end point N22. Here, on the selection track ST2, as shown in FIG. 202, three independent points P1, P2 and P3 are defined, and a geometric figure such as a closed circle G1 is formed by the independent points P1, P2 and P3. Then, an area GA1 surrounded by the circle G1 is compared with an alignment area IA2 related to the icon I1 to determine whether the icon I1 is selected. Of course, the comparison area IA2 here can also be associated with the icon I1. The area is equivalent. The comparison condition here may be whether the two areas of the area GA1 and the area IA2 intersect, and whether the two areas partially overlap each other, completely overlap, completely cover, or the centroid of the area GA1 is located in the area IA2, or When the centroid of the region IA2 is located in the region GA1, or when the geometric pattern G1 passes through, contacts the region IA2, etc., the icon I1 is determined to be circled by the selecting device M92.

Next, the selected icon I1 will be discolored or highlighted. As shown in Figure 203, a circle G1 with three independent points P1, P2, P3 passes or An inverted white icon I10 of the inner circle G2 is displayed inside. Thereafter, as shown in FIG. 204, G1 or G2 prompting the user to select the state will disappear, leaving a highlight display I10 of the selection result icon I1.

Select operation mode 3, please refer to the fifth figure, the operation diagram of the operation mode 3 of the icon selection instruction device and method proposed in this case. In Fig. 301, the user's hand movement (not shown) corresponds to a track T3 displayed on the screen by the selection means M92 shown in the second figure of the present invention. In Fig. 302, on this track T3, a comparison starting point S3 and a comparison end point E3 can be defined. As to whether the icon I1 is selected, it may be that the comparison starting point S3 and the comparison end point E3 are connected by a line segment L3, and an intersection is determined whether the area of the area between the line segment L3 and the icon I1 is compared, that is, the determination condition may be, Whether the comparison line segment L3 passes or touches the area of the area of the icon I1. If any of the above two conditions is true, it indicates that the icon I1 is selected.

As shown in FIG. 302, when the icon I1 is selected by the traversing line segment L3, the icon I1 will become the reverse white display I10 as shown in FIG. 303, or a geometric figure such as a circle G1 can also be used. The icon I1 or the white icon I10 is surrounded to further remind the user of the selected state of the icon I1.

Thereafter, as shown in FIG. 304, G1 or L3 prompting the user to select the state will disappear, leaving a highlight display I10 of the selection result icon I1.

Select operation mode four, please refer to the sixth figure, the operation diagram of the instruction device and method of the present invention is selected. In Fig. 401, the user's hand movement (not shown) corresponds to a track T4 displayed on the screen by the selection means M92 shown in the second figure of the present invention. As shown in FIG. 402, on this track T4, a comparison end point E4 can be defined. As to whether the icon I1 is selected, it can be determined by whether the trajectory T4 intersects with the icon I1, that is, the actual determination condition may be whether the comparison end point E4 falls within the area of the icon I1. Or whether the end point E4 touches the icon I1, or whether a certain portion of the track T4 touches the area of the icon I1. If any of the above conditions is true, it indicates that the icon I1 is selected. When the icon I1 is selected, the icon I1 shown in FIG. 402 becomes, and the reverse display shows I10 as shown in FIG. 403; or, a geometric figure, such as a circle G1, can also be used to surround the icon I1 or this. The highlight of the icon indicates that I10 further reminds the user of the selected state of the icon I1.

In addition, as shown in FIG. 404, when the icon I1 is selected, a reversed alignment end point E40 can be displayed in the icon I1 to indicate the result that the icon I1 has been selected.

Select operation mode five, please refer to the seventh figure, the operation diagram of the instruction device and method of the present invention is selected. In FIG. 501, the user's hand movement (not shown) is reflected by the selection device M92 of the present invention as shown in the second figure, as shown in FIG. 501, displayed on the screen. Track T5. The track T5 includes a moving track segment MT5 and a selected track segment ST5. Wherein MT5 is a motion trajectory corresponding to the movement of the selection device M92 from a first spatial position associated with a previous reference point on the screen to a second spatial position associated with the starting point N51 of the selection trajectory ST5. . As for the ST5, the operation selecting means M92 circles the icons I1 and I2, or when the matching area IA5 including the two icons I1 and I2 is circled, the movement of the hand holding the selection means M92 corresponds to The choice track. The selection track ST5 has a selection starting point N51 and a selection end point N52. Comparing a region STA5 (dashed-line enclosing region) surrounded by the selected trajectory ST5 with a contrast region IA5 (dashed-dotted-line surrounding region) surrounding the icons I1 and I2, it is determined that the map included in the region IA5 is included Whether the symbols I1 and I2 are circled at the same time. The comparison condition here may be whether the two regions of the area STA5 and the area IA5 intersect, that is, when the two partially overlap each other, completely overlap, completely cover, or the geometric center of the area STA5 is located in the area IA5, Or when the centroid of the area IA5 is located in the area STA5, or one of the conditions such as the track ST5 passing and the contact area IA5, the icons I1 and I2 included in the area IA5 or the area IA5 are determined to be simultaneously selected devices. Circled by M92.

When the area IA5 including the icons I1 and I2 is circled, as shown in FIG. 502, a geometric pattern associated with the selected track ST5, such as an ellipse G5 around the periphery of the area IA5, is displayed, indicating the area IA5. It has been circled, or the icons I1 and I2 have been circled at the same time. After that, the icons I1 and I2 can also be changed in color or in the reverse mode I10 and I20. Next, as shown in FIG. 503, the hand-held selection device M92 is operated by a first hand movement or posture M51, such as by a Yaw motion or a Roll motion, or is operated on the selection device M92. The keys are selected to select between the I10 and I20 of the two reversed white icons to determine the icon to be selected. As shown in FIG. 503, when the white icon I20 is selected via the first motion or posture M51, a geometric figure, such as a circle G51 surrounding the icon I20 or located inside the reverse white icon I20. An inner circle G52 can be displayed to remind the user of the current selection of the icon.

For example, when it is determined that the reverse white icon I20 is to be selected, the user confirms with a second hand motion or gesture M52, such as a tick "v" motion. At this time, the icon I2 is confirmed to be selected, and is displayed in the reverse type I20, as shown in FIG.

Select operation mode six, please refer to the eighth figure, the operation diagram of the instruction device and method of the present invention is selected. In FIG. 601, the user's hand movement (not shown) is reflected by the selection device M92 of the present invention as shown in the second figure, as shown in FIG. 601, displayed on the screen. Track T6. The track T6 includes a moving track segment MT6 and a selected track segment ST6. Wherein MT6 is a motion trajectory corresponding to the movement of the selection device M92 from a first spatial position associated with a previous reference point on the screen to a second spatial position associated with the starting point N61 of the selection trajectory ST6. . As for ST6, the operation selecting means M92 is used to circle the icons I1, I2, I3 and I4, or when the matching area IA6 including the four icons I1, I2, I3 and I4 is circled, the hand is held. The selection trajectory corresponding to the movement of the selection device M92. The selection track ST6 has a selection starting point N61 and a selection end point N62. Comparing a region STA6 (dashed-line enclosing region) surrounded by the selected trajectory ST6 with an alignment region IA6 (dashed-dotted-line surrounding region) surrounding the icons I1, I2, I3, and I4, it is determined that the region IA6 includes Whether these icons I1, I2, I3 and I4 are circled at the same time. The comparison condition here may be whether the areas of the area STA6 and the area IA6 intersect, that is, when the two areas partially overlap each other, completely overlap, completely cover, or the geometric center of the area STA6 is located in the area IA6. Or, if the centroid of the area IA6 is located in the area STA6, or when one of the conditions such as the track ST6 passing and the contact area IA6, the icons I1, I2, I3, and I4 included in the area IA6 or the area IA6 are determined. The circle is simultaneously selected by the selection device M92.

When the area IA6 including the icons I1, I2, I3 and I4 is circled, as shown in FIG. 602, a geometry associated with the selection track ST6, such as a circle G6 around the periphery of the area IA6, is displayed. Indicates that the area IA6 has been circled, or the symbols I1, I2, I3 and I4 have been circled at the same time. After that, the icons I1, I2, I3 and I4 can also be discolored or reversed in the way of I10, I20, I30 and I40 to display. Next, as shown in FIG. 603, the selection device M92 is operated by a first hand motion or posture M61, such as a Yaw motion, a Roll motion, or a Pitch motion, or It is a button on the operation selecting means M92, such as a direction key (not shown), for selecting between the four inverted white icons I10, I20, I30 and I40 to determine the icon to be finally selected. As shown in FIG. 603, when the white icon I20 is selected via the first motion or posture M61, a geometric figure, such as a circle G61 surrounding the icon I20 or located inside the reverse white icon I20. An inner circle G62 can be displayed to remind the user of the current selection of the icon.

When it is determined to be highlighted when selected icon I20, M62 to a user and then the second hand movement or gesture, such as a tick ^"" confirm movement. At this time, the icon I2 is confirmed to be selected, and is displayed in the reverse type I20, and the other icons I1, I3 and I4 are restored to the normal display, as shown in the figure 604.

- the actual operation mode of the above six selection operation modes is as follows

For the actual operation mode related to the selection operation mode one or two shown in the third figure and the fourth figure, please refer to the figure (a) and (b) of the ninth figure, that is, the icon selection operation mode mentioned in the present case A schematic diagram of the actual mode of operation 95. As shown in the ninth diagram (a), the selection configuration 951 of the actual operation mode 95, the display system S95 includes a display device V95, which has a display area A95, display icons I1, I2, I3, I4 and I5 and the like are displayed therein; a hand motion M951 is sensed by the selecting means D95, and is mapped to a circled track T95 displayed on the display area A95 and surrounding the icon I4.

As in the selection configuration 952 of the actual operation mode 95 shown in the ninth diagram (b), after the comparison condition as mentioned in the selection operation mode one or two is compared and it is determined that the icon I4 is the object to be selected, this The selected icon I4 is visualized by discoloration or anti-white image I40, thereby confirming that the icon I4 is successfully circled; that is, the anti-white image I40 is the display mode in which the icon I4 is confirmed to be selected.

After the selection of the icon I4 is confirmed, the selecting device D95 can sense the hand movement M952 or transfer a message to the display system S95 by pressing a button DB95 on the selection device D95 to execute the figure. The function of I4.

For the actual operation mode related to the selection operation mode 3 as shown in FIG. 5, please refer to FIG. 10(a) and (b), and the schematic diagram of the actual operation mode 96 of the icon selection operation mode 3 in this case is shown. . As shown in the tenth figure (a), the selection configuration 961 of the actual operation mode 96, the display system S96 includes a display area A96, in which the display icons I1, I2, I3, I4, and I5 are displayed; The D96 senses the hand movement M961, and then maps to a selection track T96 displayed on the display area A96 by the icon I4.

As in the selection configuration 962 of the actual operation mode 96 shown in FIG. 10(b), when the comparison condition as mentioned in the selection operation mode 3 is compared and it is determined that the icon I4 is the object to be selected, this is selected. The icon I4 is displayed by discoloration or anti-white image I40, thereby confirming that the icon I4 is successfully circled; that is, the anti-white image I40 is the display mode in which the icon I4 is confirmed to be selected.

After the selection of the icon I4 is confirmed, the selection device D96 can transmit a message to the display system S96 by sensing the hand movement M962 or by pressing a button DB96 on the selection device D96 to execute the icon. The function of I4.

For the actual operation mode related to the selection operation mode 4 as shown in FIG. 6, please refer to FIG. 11(a) and (b), and the actual operation mode of the icon selection operation mode 4 in the present case is 97. schematic diagram. As in the selection configuration 971 of the actual operation mode 97 shown in FIG. 11(a), the display system S97 includes a display area A97 in which the display icons I1, I2, I3, I4, and I5 are displayed; The device D97 senses the hand motion M971, and then maps to a selected track T97 displayed on the display area A97, and an end point E97 of the track T97 falls within the area of the icon I4.

As in the selection configuration 972 of the actual operation mode 97 shown in FIG. 11(b), after the comparison condition as mentioned in the selection operation mode 4 is compared and it is determined that the icon I4 is the object to be selected, this is The selected icon I4 is visualized by discoloration or anti-white imaging I40, thereby confirming that the icon I4 is successfully circled; that is, the anti-white imaging I40 is the display mode in which the icon I4 is confirmed to be selected.

After the selection of the icon I4 is confirmed, but the selection of the icon I4 is canceled, and the highlighted or discolored icon I40 is restored to the state of the icon I4 before the selection, the selection device D97 can sense the first hand. The movement, for example, a fork "X" motion M972, and a button DB97 on the selection device D97 can be simultaneously pressed to transmit a message to the display system S97 to cancel the reverse icon I40 to restore it to the icon I4.

For an actual operation mode related to the selection operation mode 5 shown in the seventh figure, please refer to the twelfth figure (a), (b), (c) and (d), and the icon selection operation mode proposed in the present case. A schematic diagram of the actual operation mode of V. As shown in the twelfth figure (a), the selection mode 981 of the actual operation mode 98, the display system S98 includes a display area A98, and the display icons I1, I2, I3, I4, and I5 are displayed therein; When the device D98 senses the hand movement M981, it is mapped to a selection track T981 displayed on the display area A98, and the track T981 surrounds the icons I3 and I4 which are separately displayed on the display area A98. The alignment is then compared via a comparison condition as selected in operation mode five to determine whether the icon I3 or I4 is the object to be selected.

For the second practical mode of operation related to the selection of the operation mode 5, please refer to the selection configuration 982 of the actual operation mode 98 as shown in the twelfth figure (b). In the selection configuration 982, the display system S98 includes a display area A98, and the successively connected display image arrays J11, J12, J13, J14, J15 and J21, J22, J23, J24 and J25 and the separate separated display icons I1. , I2 and the paired display icons K11, K12, etc. are displayed therein. A hand motion M982 is sensed by the selecting means D98, and is mapped to a selected track T982 displayed on the display area A98, and the track T982 surrounds the icons J12 and J13 displayed in association on the display area A98. For example, if the selected icons J12 and J13 are selected as shown in configuration 982, the selection mode 983 of the actual operation mode 98 as shown in the twelfth figure (c) is used to discolor or highlight the image J120. And J130 to appear, by which the indication symbols J12 and J13 are candidates for further acceptance of the next selection operation.

As selected in configuration 983, selection device D98 senses a selected motion, such as a yaw motion M983 that selects device D98 to rotate relative to the Z axis, which includes a left yaw motion M983L and a right yaw motion M983R. In order to select again between the candidate objects J120 and J130 displayed in reverse video. The re-selection operation may be that when the M983L or M983R motion is performed, the brightness or color of the highlighted J120 will be different from the J130 which is also displayed in reverse, thereby prompting the user to select the current state.

As shown in the twelfth diagram (d), the selection mode 984 of the actual operation mode 98, when J120 or J130 with different brightness or color is the final selection object, the selection device D98 can sense a circular motion M984C. The method is to press the DB98 to transmit a confirmation signal to the display system S98 to confirm that the last selected icon is J120 or J130 in the reversed state.

For example, if the icon J13 of the reverse display state J130 is confirmed to be the last object to be selected, the selection device may perform a function start motion, such as a tick "ˇ" motion M984V, to execute the icon. The function of J13.

As shown in the eighth figure and the first actual operation mode of the selected operation mode 6, please refer to the thirteenth figure (a), (b), (c) and (d), the icon selection in this case Schematic diagram of the actual operation mode 99 of the operation mode 5. As shown in the thirteenth figure (a), the selection configuration 991 of the actual operation mode 99, the display system S99 includes a display area A99 in which the display icons I1, I2, I3, I4, and I5 are displayed; The device D99 senses the hand motion M991, and then maps to a selection track T991 displayed on the display area A99, and the track T991 surrounds the icons I1, I2, I3 and I4 which are separately displayed on the display area A99. The alignment is then determined via the alignment conditions as selected in operation mode six to determine whether the icon I1, I2, I3 or I4 is the object to be selected.

For the second practical operation mode related to the selection operation mode 6, please refer to the selection configuration 992 of the actual operation mode 99 as shown in the thirteenth diagram (b). In the selection configuration 992, the display system S99 includes a display area A99, and the display icons have icons I1 and I2 with spaces between the icons, and the array icons J11, J12, f13, J15 with no spaces between the icons. , J16, J21, J22, J23, J24, J25 and J26, and the connected icons K11 and K12, etc.; one hand movement M992 is sensed by the selecting device D99, and then a selection displayed on the display area A99 The track T992, and the track T992 surrounds the icons J12, J13, J22 and J23 displayed in association on the display area A99. As shown in configuration 992, the selected icons J12, J13, J22, and J23 are selected as the actual operation mode 99 shown in Fig. 13(c) to be discolored or highlighted. The images J120, J130, J220 and J230 are visualized, whereby the indication symbols J12, J13, J22 and J23 are candidate objects to be subjected to the selection operation again.

As shown in configuration 993, selection device D99 utilizes sensing to select motion M993, which includes a counterclockwise roll motion M993L and a clockwise roll motion M993R relative to the X-axis motion, and an up-up motion. (Pitch-up motion) M993U and Pitch-down motion M993D to select again between the candidate objects J120, J130, J220 and J230 displayed in reverse video. These re-selection operations may be J120, J130, J220 or J230 which are displayed in reverse when performing M993L, M993R, M993U and M993D movements. When one of them is selected, J220 is selected again, its brightness or color. It will be different from J120, J130 or J230 which is also highlighted in white to remind the user of the current selection status.

As shown in the thirteenth figure (d), the selection mode 994 of the actual operation mode 99, when the brightness or color of the J220 is the final selection object, the selection device D99 can sense a circle motion M994C or J220 is confirmed by pressing DB99 to transmit a confirmation signal to display system S99 to confirm that the last selected icon is in the reversed state.

When such a state to highlight an icon J220 J22 was identified to be the last item to be selected, so that the selection sensing means to start a movement function, such as a tick, ^"" sports M994V, the icon can be executed The function of J22.

- Select the system architecture of the system to expand the interactive feedback function

Please refer to Figure 14 for a schematic diagram of the system architecture of the command device with feedback function of the user's icon selection status. As shown, the selection system 9A includes a display system S9A and a selection device D9A. There is a display area A9A in the display system S9A, and the image can be an icon I1, and the display area A9A has a definable position 3A, wherein the definable position 3A can be defined to any of the display areas A9A. position.

The selection device D9A includes a selection unit U9A. The selection unit U9A includes a button DB9A, a motion sensing unit SS9A, a processing unit P9A, a wireless transmission module U9A3, a lighting unit U9A4 and a sounding unit U9A5. The button DB9A, the motion sensing unit SS9A, the wireless transmission module U9A3, the illumination unit U9A4, and the sounding unit U9A5 are all coupled to the processing unit P9A.

The motion sensing unit SS9A has sensing capabilities for three-dimensional (x, y, z) motion and provides a signal S3 to the processing unit P9A. The motion sensing unit SS9A includes at least one gyroscope SS9A1 or/and an accelerometer SS9A2, wherein the gyroscope SS9A1 or the accelerometer SS9A2 may have one, two or three independent sensing degrees of freedom, respectively. The gyroscope SS9A1 and the accelerometer SS9A2 provide the sub-signal S31 and the sub-signal S32 in the signal S3 to the processing unit P9A, respectively.

The processing unit P9A transmits the processed or unprocessed signal S3 via the wireless transmitter U9A3 to the wireless transmitter S9A2 on the display system S9A for receiving, and the information related to the signal S3 is controlled by a display system S9A. A processing module S9A1 processes, and then the motion (not shown) sensed by the sensing unit SS9A is mapped into a track G31 and displayed on the display area A9A. Then, if a specific relationship between the trajectory G31 and the icon I1, as shown in the third to eighth embodiments, the alignment relationship described in the first mode to the sixth mode is established, and the icon I1 is determined. If selected, the processing module S9A1 will cause the circled icon I1 to be displayed in a color change (such as whitening or flashing), or simultaneously send a circle of indication signals to the wireless device via the wireless transmitter S9A2. After receiving the transmitter U9A3, the processing unit P9A is caused to send an interactive signal to cause the illumination unit U9A4 to emit light or to cause the sounding unit U9A5 to sound.

That is, the computer connected to the selection unit U9A (not shown) or the display system S9A, or the selection unit U9A itself to emit sound, emit optical frequency, generate force feedback or vibration to remind the user, the icon The selected state of I1 has been circled. This allows the user to interact with the operation of the selection device and the icon or electronic menu.

-Select the absolute and relative reference point definition and operation mode of the image area of the system

As for the mapping relationship between the operation motion and the relevant position displayed on the screen, as shown in the fifteenth figure, the operation angle range of the selection unit of the command device of the present invention is shown in the mapping diagram of the display area range of the display system, wherein the display system S9B has A display device V9B, and its display area A9B has a center point C, thereby dividing the length L and the width H of the display area A9B into (-1/2, 1/2) and (-h/2, h/2, respectively. ).

In the operation angle diagrams A1 and A2, the correspondence relationship between the angle defining area of the Roll Angle α or the Yaw Angle β and the defined area of the length L of the display area A9B may be

Among them, αS, αL and βS, βL can be arbitrarily specified, for example, αS=βS>=-π/2; αL=βL<=π/2.

The operation angle diagram A3 shows the correspondence relationship between the angle defining area of the pitch angle γ and the defined area of the width H of the display area A9B. That is,

Among them, γS, γL can be arbitrarily specified, for example, let γS>=-π/2; γL<=π/2.

In order to obtain the numerical value of the actual angle, the above-mentioned Yaw Angle β is measured by a gyroscope (Gyro), so that the Roll Angle α or the Pitch angle γ is Accelerometers or gyroscopes can be used for measurement.

In addition, the center point C can be used as the absolute position reference point on the display area A9B as the sensing motion mapping track. The activation mode of the mapping is that the hand holding device D9B turns on the power (not shown), presses the button DB9B, and operates D9B to perform a reciprocating up and down pitch motion, a left and right yaw motion, and a counterclockwise tumbling motion, and then select The device D9B transmits the roll initial angle, the deflection initial angle and the pitch initial angle read by the accelerometer and the gyroscope to the display area A9B of the display system S9B, and of course, as shown in the fifteenth figure. A display screen DA9B on the selection device D9B on the schematic A1 is displayed to remind the user to select the initial values of the three angles when the device D9B starts to be used, and the display system S9B or the selection device D9B is The initial value is zeroed, and thus, the operational relationship of the zero initial value corresponding to the three operational angles in the selection system corresponding to the initial posture of the D9B is established. Thus, the activation mapping of the center point C of the initial posture mapping area A9B of the selection device D9B is completed, and then the trajectory appearing on the display area A9B by the enlarging motion will be the center point C of the display area A9B. Absolute reference to the starting point to start the mapping.

As for the operation mode of the initial setting of the actual selection device and the relative reference point of the display area, please refer to the sixteenth figure. The operation point of the selection unit of the command device of the present invention is the absolute reference coordinate or the arbitrary point of the center point of the display area. A schematic diagram of the initialization mapping of the relative reference coordinates.

Fig. 16 (a) and (b) are schematic diagrams showing the initial configuration 9B1, 9B2 of the selection system 9B, respectively. As shown in FIG. 16(a), in order to initialize motion sensing or initiate motion sensing, the button DB9A on the selection unit U9B may be pressed to initiate sensing, or the sensing may be initiated by a specific motion. Alternatively, the accelerometer SS9B1 can be utilized, and the specific action can be discriminated by interpreting acceleration and deceleration to initiate the sensing function, for example, the motion sensing function of the selection unit U9B is initiated by an up and down pitch swing F41.

As shown in FIG. 16(b), after the motion sensing function of the selection unit U9B is activated, the center point C of the image area A9B will be displayed together with the motion F42 of the selection unit U9B. point. And any reference point G421 on the track G42 can be read out by pressing the button DB9A, and the selection unit U9B can use the G421 as a new relative reference point, and the point is taken as the next point. The starting point of the trajectory mapped by a motion.

- Icon selection operation flow chart

Please refer to FIG. 17, which is an operational flowchart of a selection system embodiment 9B of the instruction apparatus and method shown in FIG. As shown in Fig. 17, in step Q06, the operation range of the selection unit U9B is mapped to the range of the display area A9B to associate the motion posture of any of the defineable positions 3A and the selection unit U9B in the area A9B. In step Q02, motion sensing is initiated. In step Q04, the center point C of the initialization device and the display area is initialized to be an absolute reference point. If necessary, step Q08 is performed to define a relative reference point, for example, a point on the defined track G42 is taken as the new track start position reference point G421 for the next action mapping operation. In step Q09, it is determined whether or not to perform correction compensation; if the result is YES, the process proceeds to step Q10; if the result is no, the process proceeds to step Q12. In step Q10, the correction and compensation of the reference point G421 are performed. In step Q12, the operation mode is selected for the icon used to compare the relevant operating conditions so that the icon I1 is selected. In step Q14, the preset function of the icon I1 is executed using the motion M994V as shown in the fourteenth (b).

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an icon in an image area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding a first signal; and a processing unit, generating a first track according to the first signal, and defining a first area in the image area, and displaying the image according to the first area and the icon A relationship in a second region of the region to determine whether the icon is or has been selected.

The practical practice of the above preferred embodiment is to directly circle the icon by moving the corresponding trajectory.

Among them, the instruction is a selection instruction.

The processing unit then converts the first signal to the first trajectory.

The first track includes a first arc, a second arc and a first line segment, and at least one of the plurality of second line segments; and when the first track is the first arc, The arc angle of the first arc is equal to or greater than 180°.

Wherein the first area comprises a closed area.

Wherein, when the relationship of the first area with respect to the second area is an intersection, that is, partially overlapping, completely overlapping, completely covering, the centroid of the first area is located in the second area, and the first track passes The processing unit causes the icon to be selected when contacting one of the second regions or the like.

After the processing unit determines that the icon is selected, the command device is configured to have a second motion, converting the second motion to a second signal or a second track, and according to the second signal or the second The track determines whether a preset function of the icon is executed.

The second track is one of a hook shape, a fork shape and a circle shape.

After the processing unit determines that the icon is selected, the command device is configured to have a second motion, and analyzes an acceleration and deceleration distribution of the second motion to determine whether a preset function of the icon is executed.

The second motion is one of a tick, a cross, a wavy, a triangle, a curved arc, and a circle.

Wherein, the first movement may be generated by a limb, such as a body part such as a hand, a foot, a head and neck, a shoulder, a waist, or the like.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an icon in an image area, comprising a motion sensing unit, sensing a first motion, and generating a corresponding one a first signal; and a processing unit, generating a first track according to the first signal, and defining a first area in the image area, and according to the first area and the icon and at least A picture or a total of at least two icons displayed in a relationship of a second area in the image area to determine whether the icon is to be selected.

In the above preferred embodiment, the actual operation is to directly circle a plurality of icons corresponding to the trajectory corresponding to the motion, and then select the final icon to be selected.

The first track includes a first arc, a second arc and a first line segment, and at least one of the plurality of second line segments; and when the first track is the first arc, The arc angle of the first arc is one of 360°, approximately 360°, and over 360°.

Wherein the first area comprises a closed area.

Wherein the relationship of the first area with respect to the second area is an intersection, that is, partially overlapping, completely overlapping, completely covering, the centroid of the first area is located in the second area, and the first track passes, The processing unit causes the at least two icons to be selected when contacting one of the second regions or the like.

Wherein, the icons may be highlighted by a selected motion of the command device, or the track size may be reduced and displayed alternately on the icons.

Among them, the icon can be selected by a button to make the icons appear in turn.

The selected motion may be a Yaw motion, a Pitch motion, or a Roll motion.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a signal to a reaction medium in a specific area, comprising a motion sensing unit, sensing a first motion, and generating a corresponding one a first signal; and a corresponding device, generating at least three reference positions corresponding to the first signal, and defining a first region of the specific region, and according to the first region and the reaction medium in the specific region One of the second regions in the relationship to decide whether to convey the instruction to the reaction medium.

In the implementation of the above preferred embodiment, three reference positions are determined by the motion trajectory, and the icon is selected according to a geometric figure corresponding to the three reference positions.

Wherein, the specific area is an image area.

Wherein, the reaction medium is an icon.

Wherein, the corresponding device is a processor.

Wherein the at least three reference positions form a trajectory.

Among them, the reaction medium is often displayed in the specific region.

Wherein, the trajectory is a geometric trajectory, which may be a circle, an ellipse, a polygon, such as a triangle, a rectangle, a pentagon, etc., or a closed line of a heart line, a rose line, etc. It can also be an arc, a curve such as a cycloid, etc., a non-closed track.

The first area is a first area area surrounded by the specific track.

Wherein the second area is a second area area associated with the reaction medium.

The relationship refers to the intersection of the first area and the second area, that is, a coverage, a partial coverage, an overlap or a partial overlap.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a signal to a reaction medium in a specific area, comprising a motion sensing unit, sensing a first motion, and generating a corresponding one a first signal; and a corresponding device, generating at least three reference positions corresponding to the first signal, and defining a first region of the specific region, and according to the first region and the reaction medium and at least Another reaction medium or the like has a relationship of at least two of the two reaction media in a second region of the particular region for determining whether to convey the instruction to the reaction medium.

In the above preferred embodiment, three reference positions are determined by the motion trajectory during the implementation, and a plurality of icons are circled according to a geometric figure corresponding to the three reference positions.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a command medium in a specific area, which includes a sensing unit, sensing a first instruction medium, and generating a corresponding one. a first signal; and a corresponding device, generating at least three reference positions corresponding to the first signal, and defining one of the first regions in the specific region, and according to the first region and the reaction medium in the specific region A relationship between one of the second regions for deciding whether to communicate the instruction to the reaction medium.

In the preferred embodiment described above, a motion is included in a command medium to correspond to a geometric figure, and the icon is circled according to the area enclosed by the instruction.

Among them, the instruction medium is a movement.

Wherein, the instruction medium is a physical effect, such as an audio, an optical frequency, a non-contact force, such as an electromagnetic wave, an electric power, a magnetic force, an inertial force or a contact force or a mechanical force, such as a pressure, a Friction or a stretch.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a command medium in a specific area, which includes a sensing unit, sensing a first instruction medium, and generating a corresponding one. a first signal; and a corresponding device, corresponding to the first signal to generate at least two reference positions, and according to the relationship between the at least two reference positions and the reaction medium, for the reaction medium to determine whether to operate.

In the preferred embodiment described above, the motion is directly converted into a geometric figure, such as a straight line, and the icon is selected with an intersection relationship between the line and the icon.

Wherein the at least two reference locations form one of a geometric figure or a geometric area.

Wherein, the action of the reaction medium refers to one of conveying the instruction to the reaction medium and causing the reaction medium to transmit a response signal.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an instruction to a reaction medium, the method comprising an instruction unit configured to transmit a command medium, and thereby generating at least two reference positions, and according to the At least two reference locations are associated with one of the reaction media for the reaction medium to determine whether to act.

In a preferred embodiment of the present invention, a method for communicating instructions is provided, wherein the following steps are used to provide a signal to a reaction medium, including the following steps, providing at least two reference positions in response to a first instruction medium; and One of the reaction media is for the reaction medium to determine whether it is acting.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a command medium in a specific area, which includes a sensing unit, sensing a first instruction medium, and generating a corresponding one. a first signal; and a corresponding device, corresponding to the first signal to generate two reference positions to form a geometric line, and according to the relationship between the geometric line and the reaction medium, for determining whether to transmit the instruction to the reaction medium .

Wherein, the relationship is a positional relationship between the geometric line and one of the second regions of the reaction medium in the specific region.

The positional relationship is whether the geometric line has an intersection relationship with the second area.

The intersection relationship may be that the geometric line passes through the second area, or the geometric line touches a boundary of the second area.

Among them, the geometric lines are straight lines.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting a command medium in a specific area, which includes a sensing unit, sensing a first instruction medium, and generating a corresponding one. a first signal; and a corresponding device, temporarily generating a reference position corresponding to the first signal, and determining whether to transmit the instruction to the reaction medium according to the relationship between the reference position and the reaction medium.

In the above preferred embodiment, a reference position is specified on the trajectory of the mapping by motion, and the icon is directly selected by the reference position, or a geometric figure is formed at the position, and the geometric figure is used in the figure. The positional relationship of the symbols to select the icon.

Wherein the reference location is located in the specific area.

Wherein the relationship is the relationship between the reference location and the location of the reaction medium in the particular region.

Wherein, the reaction medium forms a second region at a position of the specific region.

Among them, the term "temporary" means that the time is between 0.1 and 3 seconds.

Wherein, the first signal is more corresponding to generate a geometric figure at the reference position, and the geometric figure may be a circle, an ellipse, a polygon, such as a triangle, a rectangle, a pentagon or the like.

Wherein, whether the instruction is communicated to the reaction medium is determined according to whether the geometric pattern at the reference position has an intersection relationship with the second area, that is, overlay, overlap or intersection.

Wherein, whether the instruction is communicated to the reaction medium is determined according to whether the reference position is located in the second area.

Wherein, the command includes a command message for selecting and changing a representation of the selected reaction medium.

The expression mode may be a reverse display, a color change, a length and a width scale display, an unequal scale display, a flashing display, an interactive color display, or an audio.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an instruction to a reaction medium, including a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; A corresponding device temporarily provides a reference position corresponding to the first signal, and based on the relationship between the reference position and the reaction medium, for determining whether to transmit the instruction to the reaction medium.

In the preferred embodiment described above, a reaction medium or an icon is selected by directly mapping a signal or a geometric pattern associated therewith in a non-specific area.

Wherein the reaction medium is located in a specific area.

Wherein the reference location is located in the specific area.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an instruction to a reaction medium, including a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; A corresponding device temporarily generates a reference signal corresponding to the first signal, and based on the relationship between the reference signal and the reaction medium, for determining whether to transmit the instruction to the reaction medium.

In the preferred embodiment described above, the motion directly specifies a geometric figure, such as a straight line to select the icon.

The reference signal is one of a location and a region.

The establishment of the relationship refers to whether the first location or the first region has an intersection relationship with a second location or a second region where the reaction medium is located, that is, overlaps, overlaps or intersects each other.

Wherein, according to the establishment of the relationship, the corresponding device sends an indication signal to cause the instruction device to generate different audio, optical frequency or vibration frequency.

In the preferred embodiment described above, there is an interactive relationship or an interactive function between the command device and the selected reaction medium.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an instruction to a reaction medium, including a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; A corresponding device temporarily generates a reference parameter corresponding to the first signal, and according to the relationship between the reference parameter and the reaction medium, for the reaction medium to determine whether to operate.

The reference parameter is selected from the group consisting of a reference position, a reference geometry, a geometric region, and a reference signal.

Wherein, the action of the reaction medium refers to one of conveying the instruction to the reaction medium and causing the reaction medium to transmit a response signal.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an instruction to a reaction medium, comprising an instruction unit configured to transmit a command medium and to temporarily generate a reference parameter, and according to the The reference parameter is related to one of the reaction media for the reaction medium to determine whether to operate.

In a preferred embodiment of the present invention, an instruction communication method is provided, wherein the following step is used to provide a reference parameter in response to a first instruction medium; and the reference parameter and the reference parameter A relationship of the reaction medium for the reaction medium to determine whether or not to act.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an icon in an image area, the image unit including an instruction unit configured to perform a first motion to convert the first motion Is a first trajectory, and determining a first region of the image region, and according to the relationship between the first region and a second region of the icon displayed in the image region, for determining whether to convey The instruction is in the icon.

In the above preferred embodiment, the motion directly corresponds to a track in an image area, and an instruction unit including a sensing unit and a processing unit is used to select an icon.

The command unit includes a motion sensing unit that converts the first motion into a first signal, and a processing unit that converts the first signal into the first track, and determines the first region according to the first track. And determining whether to transmit the instruction to the icon according to the first area and the second area.

The motion sensing unit includes a gyroscope that senses the first motion to generate the first signal.

Wherein the motion sensing unit comprises a gyroscope having at least two sensing degrees of freedom, sensing the first motion to generate a first portion of the first signal; and an accelerometer having at least two The degree of freedom senses the first motion to produce a second portion of the first signal.

The processing unit includes a microcontroller (Microcontroller) or a microprocessor (Microprocessor) or a digital signal processor (Digital Signal Processor) or a central processing unit (CPU).

In the command device of the above preferred embodiment, the first motion is formed by one hand driving the command unit; and the first motion includes at least one of a three-dimensional motion and a two-dimensional motion.

The first track includes a first arc, a second arc and a first line segment, and at least one of the plurality of second line segments; and when the first track is the first arc, The arc angle of the first arc is one of 360°, approximately 360°, and over 360°.

Wherein the first area comprises a closed area.

Wherein, when the relationship of the first area with respect to the second area is an intersection relationship, that is, partially overlapping, completely overlapping, completely covering, or the centroid of the first area is located in the second area, and the first track When passing, contacting one of the second regions, etc., the command unit communicates the instruction to the icon.

Wherein, after the instruction unit determines to convey the instruction to the icon, the icon is selected; thereafter, the command unit is configured to have a second motion, and the second motion is converted to a second track, and according to the The second track determines whether a preset function of the icon is executed.

The second track is one of a hook shape, a fork shape and a circle shape.

The command unit determines that the icon is selected, the command unit is configured to have a second motion, and analyzes an acceleration and deceleration distribution of the second motion to determine whether a preset function of the icon is executed.

The second motion is one of a tick, a cross, a wavy, a triangle, a curved arc, and a circle.

In a preferred embodiment of the present invention, an instruction device is provided for communicating a command medium in a specific area, the method comprising an instruction unit configured to perform a first motion to convert the first motion Is a first trajectory, and determining a first region of the image region, and displaying a second region in the specific region according to the first region and the reaction medium for deciding whether to convey the instruction The reaction medium.

In the above preferred embodiment, the motion is mapped into a track in a specific area, wherein an instruction unit synthesizes the sensing unit and the corresponding unit function, and uses the track to select the icon.

In a preferred embodiment of the present invention, an instruction device is provided for communicating an instruction in a specific area of a reaction medium, comprising an instruction unit configured to transmit a command medium and to temporarily provide a Referring to the location, and depending on the relationship of the reference location to the reaction medium, for determining whether to communicate the instruction to the reaction medium.

In the above preferred embodiment, the motion forms a reference position in a specific area, wherein an instruction unit synthesizes the sensing unit and the corresponding unit function, and uses the reference position to select the icon.

Wherein the command medium is a motion, the motion is converted into a signal, and the signal is converted into the reference position; and the relationship is a relationship between the reference position and a position of the reaction medium in the specific area.

Wherein the relationship of the position is that when the reference position is tied to a relevant area of the reaction medium, the instruction is communicated to the reaction medium.

In the above preferred embodiment, the command device can generate a geometric figure relative to the reference position, for example, the reference position can be a center point, and the geometric figure can be a circle, an ellipse, a polygon, For example, a triangle, a rectangle, a pentagon, and the like.

Wherein, whether the instruction is communicated to the reaction medium is determined according to whether the geometric figure overlaps or intersects with the relevant area area.

Among them, the term "temporary" means that the time is between 0.1 and 3 seconds.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an instruction to a reaction medium, comprising an instruction unit configured to transmit a command medium and to temporarily generate a reference signal, and according to the The reference signal is associated with one of the reaction media for determining whether to communicate the instruction to the reaction medium.

In the above preferred embodiment, the motion forms a reference position in a specific area, wherein an instruction unit synthesizes the sensing unit and the corresponding unit function, and uses the reference signal to select the icon.

The reference signal is one of a location and a region.

Wherein, a geometric shape or a contour shape corresponding to the region produces a geometric shape similar to the geometric shape or the contour contour, such as a circle, an ellipse, a rectangle, a triangle, or a polygon.

In a preferred embodiment of the present invention, a command transmission method is provided. The following method is used to convert an icon into a first track according to the first step. Determining a first region in the image region; and determining, according to the first region, a relationship between the first region and the second region of the image region for determining whether to convey the instruction to the icon.

In the above preferred embodiment, a motion is mapped to a track in an image area, and the track is used to select an icon.

In a preferred embodiment of the present invention, a method for communicating instructions is provided, wherein the following one of the instructions is used to process a medium in a specific area, including the following steps, generating at least three reference positions in response to a first motion; Positioning, generating a first region; and determining whether to communicate the instruction to the reaction medium in response to the relationship between the first region and the second region of the reaction region displayed in the particular region.

In the above preferred embodiment, the motion corresponds to the three reference positions in a specific area, and the reference position is used to select the icon.

The specific area is an image area; wherein the reaction medium is an icon; and the first area is located in the image area.

In a preferred embodiment of the present invention, a command transmission method is provided, wherein the following one step is used to generate a medium in a specific area, and the following steps are performed to generate a reference position in response to a first motion to form a geometric line. And a relationship between the geometric line and one of the second regions of the reaction medium displayed in the particular region for determining whether to convey the instruction to the reaction medium.

In the preferred embodiment described above, the two reference positions are mapped by a motion in a particular area, and a geometric line is formed by the two reference positions to select an icon.

Wherein, the geometric line is a straight line.

In a preferred embodiment of the present invention, a method for communicating instructions is provided, wherein the following steps are used to generate a reference position in response to a first motion; and the reference position and the response are A relationship between the media to decide whether to convey the instruction to the reaction medium.

In the above preferred embodiments, temporary is a necessary limitation and feature of the present invention.

Another method feature in the above preferred embodiment is that the motion maps a reference position and is not limited to a particular area, but the reference position forms a geometric line to select the icon.

Wherein the reaction medium is located in a specific area; the reference position is located in the specific area and forms a first area; and the reaction medium is located in the specific area and forms a second area.

In a preferred embodiment of the present invention, a command communication method is provided, wherein a reference signal is temporarily provided to a reaction medium by using the following steps, and a reference signal is temporarily provided in response to a first instruction medium; and A relationship of the reaction medium for determining whether to convey the instruction to the reaction medium.

The method in the above preferred embodiment is characterized in that a command medium is provided in motion to provide a reference signal, and the reference signal is used to transmit an instruction to a reaction medium, such as selecting an icon.

Wherein, the command medium is a first motion; the reference signal is a first position signal; temporarily means that the signal appears for a time between 0.1 and 3 seconds.

The command transmission method in the above preferred embodiment further includes the steps of: converting the first motion to a first signal; and converting the first position signal to the first trajectory.

The command communication method in the above preferred embodiment further includes the following steps: starting the first motion; initializing a reference point of the first track; and correlating the posture of the first motion to perform correction and compensation of the reference point.

Wherein the reaction medium is located in a specific area; the first position signal is located in the specific area and forms a first area; and the reaction medium is located in the specific area and forms a second area.

Wherein, the method further includes the following steps, when the relationship of the first area relative to the second area is partially overlapping, completely overlapping, completely covering, and the centroid of the first area is located in one of the second areas, The instruction is in the reaction medium.

Wherein, the command is transmitted to the reaction medium, and the reaction medium can be in a function execution preparatory state, the method further comprising the steps of: converting a second motion into a second trajectory; and determining the second trajectory according to the second trajectory Whether a predetermined function of the reaction medium is performed.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an instruction to a first reaction medium, comprising: a first response unit, generating a signal in response to a command medium; and a second response unit Generating at least a two-position reference based on the signal, and determining whether to communicate the instruction to the first reaction medium based on the relationship between the first reaction medium and the at least two position reference.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an instruction to a first reaction medium, comprising: an instruction unit configured to transmit a command medium to generate at least two reference signals, and according to the At least two reference signals are associated with one of the first reaction media for determining whether to communicate the command to the first reaction medium.

In a preferred embodiment of the present invention, an instruction device is provided for transmitting an instruction to a first reaction medium, comprising: a first response unit, generating a signal in response to a command medium; and a second response unit Temporarily generating a set of a reference parameter, a position reference and a reference signal according to the signal, and selecting one of the reference signal and the reference signal, the position reference and the reference signal according to the first reaction medium a relationship for deciding whether to convey the instruction to the first reaction medium.

In a preferred embodiment of the present invention, an instruction device is provided for conveying an instruction to a first reaction medium, comprising: a notification unit, generating a corresponding signal in response to a command medium; and a response unit, Corresponding to a signal, generating a set of a reference parameter, a position reference and a reference signal, and according to the first reaction medium and a relationship from the reference parameter, the position reference and the selected one of the reference signals For deciding whether to convey the instruction to the first reaction medium.

The technical advancement of this case relative to the operation of the existing 3D aerial mouse is, basically, the case is to map the motion to the trajectory, and then the area circled by the trajectory, or the trajectory itself, and the icon to be selected. There is an associated comparison area, the area to area, or the intersection of the track to the area, or the geometric relationship of the point to the area, to determine whether the icon is selected. In essence operation, the selection of the electronic menu item on the human-machine graphics interface is performed by mapping the trajectory operation mode with the natural movement of the hand. When the item on the menu is selected, the natural action of the wrist and arm is used to make the preset function of this option be executed. This kind of ergonomic intuitive operation is not only novel, but also effective in the convenience of the free operation of the 3D aerial mouse selection facility. Therefore, it is not the existing technology on the market, such as the Gyration 3D remote control or the Logitech Air Mouse, which is based on the operational nature of the 2D mouse that is limited to the movement of the desktop plane, and can only operate the cursor on the general screen, by moving After the cursor on the screen or an object to click on the icon on the screen, the active mouse button is pressed twice to activate the preset function of the icon. This practical operation technique actually The inability to play the 3D mouse has the convenience of having more freedom in a spatial dimension.

In summary, the command device and method of the present invention can achieve the convenience and the efficiency of the instruction device set by the invention content, and the 3D space degree of freedom operation with a degree of freedom of spatial dimension can be effectively achieved. The above descriptions are only the preferred embodiments of the present invention. Any equivalent modifications or variations made by those skilled in the art of the present invention should be included in the scope of the following patent application.

【references】

Information disclosure:

1. US20050125826_Control Framework with a Zoomable Graphical User Interface for Organizing Selecting...

2. US5440326_Gyroscopic Pointer

3. US5898421_Gyroscopic Pointer and Method US7233316_Multimedia User Interface

4. US7262760_3D Pointing Devices with Orientation Compensation and Improved Usability

Previous technical literature:

1. US2309853_Rate and Attitude Indicating Instrument

2. US3782205_Temperature Compensated Digital Inertial Sensor

3. US4267731_Force Balanced Vibratory Rate Sensor

4. US4489609_Gyroscopes

5. US4580006_Method ahd Apparatus for Providing Two Dimension P...

6. US4601206_Accelerometer System

7. US4639547_Marking Device for Use with Inductive Measuring Sensor

8. US4644793_Vibrational Gyroscope

9. US4831544_Attitude and Heading Reference Detecting Apparatus

10. US4839838_Spatial Input Apparatus

11.US5068645_Computer Input Device Using An Orientation Sensor

12. US5097707_Rotation Sensor

13. US5142655_Computer Input Device Using an Orientation Sensor

14. US5287119_Computer Input Device Using An Orientation Sensor

15. US5288078_Control Interface Apparatus

16. US5329276_Multidimensional Signal Input Device

17. US5363120_Computer Input Device Using Orientation Sensor

18. US5453758_Input Apparatus

19. EP1775656A1_Inertial Sensing Input Apparatus

20. US6375572_Protable Game Apparatus with Acceleration Sensor and Information Storage Medium

21. US6504526_Wireless Pointing System

22. US6529114_Method and Apparatus for Motion Activated Control of An Electronic Device

23. US6641482_Protable Game Apparatus with Acceleration Sensor and Information Storage Medium...

24. US6742410_Operating Element

25. US6834561_Radially Actuated Control Moment Gyroscope

26. US6908386_Game Device Changing Sound and An Image in Accordance with a Tilt Operation

27. US7030856_Method and System for Controlling a Display Device

28. US7034283_Absolute Incremental Position Encoder and Method

29. US7096619_Equipment Operator Personalization Device

30. US7122004_Method and Apparatus of Enhancing Learning Capacity

31. US7158118_3D Pointing Devices with Orientation Compensation and Improved Usability

32. US7223173_Game System and Game Information Storage Medium Used for Same

33. US7233316_Multimedia User Interface

34. US7236156_Methods and Devices for Identifying Users Based on Tremor

35. US7239301_3D Pointing Devices and Methods

36. US7262760_3D Pointing Devices with Orientation Compensation and Improved Usability

37. US7351152_Display of an Image Based on Detected Angular Velocity

38. USD541805_Data Input and Cursor Control Device

101,102,103,104. . . Icon selection operation mode diagram

201,202,203,204. . . Icon selection operation mode diagram

301,302,303,304. . . Icon selection operation mode diagram

401, 402, 403, 404. . . Icon selection operation mode diagram

501, 502, 503, 504. . . Icon selection operation mode diagram

601,602,603,604. . . Icon selection operation mode diagram

91,92. . . Icon selection system

95, 96, 97, 98. . . The actual operation of the icon selection

9A. . . Selection system

9B. . . Initial system

911,912. . . Select configuration

951,952. . . Select configuration

961,962. . . Select configuration

971,972. . . Select configuration

981,982,983,984. . . Select configuration

991,992,993,994. . . Select configuration

9B1, 9B2. . . Initial configuration

3A. . . Definable location

A1. . . Roll motion α

A2. . . Yaw motion β

A3. . . Pitch motion γ

A91, A92, A95, A96. . . Display area

A97, A98, A99, A9A, A9B. . . Display area

C. . . Center point

C91. . . cursor

H. . . Display area width

L. . . Display area length

I1, I2, I3, I4, I5 and I6. . . Icon

I10, I20, I30 and I40. . . Icon, highlighted

A1, A2, A3, A4, A5, A6, A7 and A8. . . Line segment

D95, D96, D97, D98, D99, D9B. . . Selection device

DA9B. . . Display

DB95, DB96, DB97. . . Select device button

DB98, DB99, DB9A, DB9B. . . Select device button

U9A, U9B. . . Selection unit

E3. . . Contrast endpoint

E4. . . Contrast endpoints, compare endpoints

E40. . . Contrast display

F21. . . motion

F41, F42. . . motion

G421. . . Reference point

G21, G31, G42. . . Trajectory

G5. . . Geometry - ellipse

G1, G51, G6 and G61. . . Geometry - round

G2, G52, G62. . . Geometry - circle, inscribed circle

G6. . . Geometry - round

GA. . . Moving path

H21. . . region

IA1, IA2, IA5 and IA6. . . Alignment area

K21. . . region

L3. . . Contrast line segment

M92. . . Selection device

M51. . . Movement, left and right yaw motion

M52, M62. . . Sports, tick ^""

M61. . . Movement, left and right yaw motion or rolling (Yaw or Roll motion) and up and down pitch motion (Pitch motion)

M951, M952. . . motion

M961, M962. . . motion

M971, M972. . . motion

M981, 982. . . motion

M983, M983R, M983L. . . motion

M984O, M984V. . . motion

M991, M992. . . motion

M993, M993R, M993L. . . motion

M993U, M993D, M994C, M994V. . . motion

MT1, MT2, MT3, MT4, MT5 and MT6. . . Motion track

N11, N21, N51 and N61. . . Select track starting point

N12, N22, N52 and N62. . . Select track end point

P1, P2 and P3. . . Independent point

P92, P9A. . . Processing unit

P921. . . microprocessor

Q02, Q04, Q06. . . Command device and method operation procedure

Q08, Q1O, Q12, Q14. . . Command device and method operation procedure

S3. . . Contrast starting point

S91, S92, S95, S96. . . display system

S97, S98, S99, S9A, S9B. . . display system

S9A1. . . Processing module

S9A2. . . Wireless transmitter

SS92, SS9A. . . Motion sensing unit

SS921, SS9A1, SS9B1. . . Gyro

SS922, SS9A2, SS9B2. . . Accelerometer

ST1, ST2, ST3, ST4, ST5 and ST6. . . Select track

STA1, STA2, STA5 and STA6. . . Circled area

T1, T2, T3, T4, T5 and T6. . . Trajectory

T95, T96, T97, T981, T982, T991, T992. . . Trajectory

T95, T96, T97, T981, T982, T991, T992. . . Trajectory

U92. . . Selection unit

U9A3. . . Wireless transmitter

U9A4. . . Light unit

U9A5. . . Sounding unit

V92, V95, V9B. . . Display device

This case can be further explained by the detailed description of the following drawings:

The first picture (a) and (b): a schematic diagram of the selection and configuration of the conventional icon selection system;

Figure 2 (a): Schematic diagram of the system architecture of the conventional selection device proposed by the inventor in this case;

Figure 2 (b): Schematic diagram of the system architecture of the command device proposed in this case;

The third figure: a schematic diagram of the icon selection operation mode of the instruction device and method proposed in the present case;

The fourth picture: the schematic diagram of the icon selection operation mode of the instruction device and method proposed in this case;

The fifth picture: the schematic diagram of the icon selection operation mode of the instruction device and method proposed in this case;

Figure 6: Schematic diagram of the icon selection operation mode of the instruction device and method proposed in this case;

Figure 7: Schematic diagram of the icon selection operation mode of the instruction device and method proposed in this case;

The eighth picture: the schematic diagram of the icon selection operation mode of the instruction device and method proposed in this case;

Figure 9 (a) and (b): Schematic diagram of the actual operation mode of the icon selection operation modes 1 and 2 in this case;

Figure 10 (a) and (b): Schematic diagram of the actual operation mode of the icon selection operation mode proposed in this case;

Figure 11 (a) and (b): Schematic diagram of the actual operation mode of the icon selection operation mode proposed in this case;

Twelfth figure (a), (b), (c) and (d): a schematic diagram of the actual operation mode of the icon selection operation mode 5 proposed in the present case;

Thirteenth figure (a), (b), (c) and (d): a schematic diagram of the actual operation mode of the icon selection operation mode 5 proposed in the present case;

Figure 14: Schematic diagram of the system architecture of the instruction device of the present invention with the function of returning the user's icon selection status;

The fifteenth figure: the mapping diagram of the operating angle range of the selection unit of the command device of the present invention and the display area range of the display system;

Figure 16 (a) and (b): a schematic diagram of the initial mapping of the center point absolute reference coordinate or the relative reference coordinate of any point in the operational attitude mapping display area of the selection unit of the command device of the present invention;

Figure 17: Flow chart of the operation method of the instruction device and method of the present case.

98. . . The actual operation of the icon selection

981,982,983 and 984. . . Select configuration

S98. . . display system

A98. . . Display area

T981, I982. . . Trajectory

I1, I2, I3, I4, I5. . . Icon

J11, J12, J13, J14, J15. . . Icon

J21, J22, J23, J24, J25. . . Icon

K11, K22. . . Icon

J120, J130. . . Icon highlighting

D98. . . Selection device

DB98. . . Select device button

M981, M982. . . motion

M983R. . . Right yaw motion

M983L. . . Left yaw motion

M984C. . . Circle motion

M984V. . . Tick movement

Claims (105)

An instruction device for transmitting an icon in an image area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals; and a processing unit, Generating a first trajectory according to the first signal, and defining a first region of the image region, and according to the relationship between the first region and a second region of the image region displayed in the image region To determine if the icon is or has been selected. For example, the instruction device of claim 1 of the patent scope, wherein the instruction is a selection instruction. The instruction device of claim 1, wherein the processing unit converts the first signal to the first track. The command device of claim 1, wherein the first track comprises at least one of a first arc, a second arc and a first line segment, and a plurality of second line segments; and when the first When a trajectory is the first arc, the arc angle of the first arc is equal to or greater than 180°. The command device of claim 1, wherein the first area comprises a closed area. The instruction device of claim 1, wherein when the relationship of the first region with respect to the second region is an intersection, that is, partially overlapping, completely overlapping, completely covering, the centroid of the first region is located at the first The processing unit causes the icon to be selected within the second region, and when the first track passes, contacts one of the second regions, and the like. The instruction device of claim 6, wherein the processing unit determines that the icon is selected, the command device is configured to have a second motion, and the second motion is converted to a second signal or a second track. And determining, according to the second signal or the second track, whether a preset function of the icon is executed. The command device of claim 7, wherein the second track is one of a hook shape, a fork shape and a circle shape. The instruction device of claim 6, wherein the processing unit determines that the icon is selected, the command device is configured to have a second motion, and analyzes an acceleration and deceleration distribution of the second motion to determine the icon. Whether a preset function is executed. The instruction device of claim 7, wherein the second motion is one of a tick, a cross, a wavy, a triangle, an arc, and a circle. The instruction device of claim 1, wherein the first movement may be generated by a limb, such as a body part such as a hand, a foot, a head and neck, a shoulder, a waist, or the like. An instruction device for transmitting an icon in an image area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals; and a processing unit, Generating a first trajectory according to the first signal, and defining a first region in the image region, and according to the first region and at least two other icons of the icon and at least another icon around the image A relationship of one of the second regions displayed in the image region to determine whether the icon is to be selected. The instruction device of claim 12, wherein the first track comprises at least one of a first arc, a second arc and a first line segment, and a plurality of second line segments; and when the first When a trajectory is the first arc, the arc angle of the first arc is one of 360°, approximately 360°, and over 360°. The command device of claim 12, wherein the first region comprises a closed region. The instruction device of claim 12, wherein the relationship between the first region and the second region is an intersection, that is, partially overlapping, completely overlapping, completely covering, and the centroid of the first region is located in the second The processing unit causes the at least two icons to be selected within the region, and when the first track passes, contacts one of the second regions, and the like. The instruction device of claim 12, wherein the icons are rotated by a selected motion of the command device, or the track size is reduced and displayed alternately on the icons. . For example, the instruction device of claim 12, wherein the icon can be selected by a button to make the icons appear in turn. The command device of claim 12, wherein the selected motion is a Yaw motion, a Pitch motion, or a Roll motion. An instruction device for transmitting a response medium in a specific area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals; and a corresponding device, Corresponding to the first signal, generating at least three reference positions, and defining one of the first regions in the specific region, and according to the relationship between the first region and a second region of the reaction medium in the specific region For deciding whether to convey the instruction to the reaction medium. The instruction device of claim 19, wherein the specific area is an image area. For example, the instruction device of claim 19, wherein the reaction medium is an icon. The instruction device of claim 19, wherein the corresponding device is a processor. The command device of claim 19, wherein the at least three reference positions constitute a trajectory. The instruction device of claim 19, wherein the reaction medium is often displayed in the specific area. The instruction device of claim 23, wherein the trajectory is a geometric trajectory, which may be a circle, an ellipse, a polygon, such as a triangle, a rectangle, a pentagon, etc., or a A closed trajectory such as a heart line or a rose line may also be an arc, a curve such as a pendulum or the like, and a non-closed trajectory. The command device of claim 25, wherein the first area is a first area area surrounded by the specific track. The command device of claim 19, wherein the second region is a second area associated with the reaction medium. The instruction device of claim 19, wherein the relationship refers to the intersection of the first area and the second area, that is, a coverage, a partial coverage, an overlap or a partial overlap. An instruction device for transmitting a response medium in a specific area, comprising: a motion sensing unit, sensing a first motion, and generating a corresponding one of the first signals; and a corresponding device, Corresponding to the first signal, generating at least three reference positions, and thereby defining one of the first regions in the specific region, and according to the first region and the reaction medium and at least another reaction medium around it, at least two A relationship of a second region of the reaction medium in the particular region for determining whether to communicate the instruction to the reaction medium. An instruction device for transmitting a response medium in a specific area, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device, Corresponding to the first signal, generating at least three reference positions, and thereby defining one of the first regions in the specific region, and according to the relationship between the first region and a second region of the reaction medium in the specific region, In order to decide whether to convey the instruction to the reaction medium. For example, the instruction device of claim 30, wherein the instruction medium is a movement. The instruction device of claim 30, wherein the instruction medium is a physical effect, such as an audio, an optical frequency, a non-contact force, such as an electromagnetic wave, an electric power, a magnetic force, an inertial force or a contact. Force or a mechanical force, such as a pressure, a friction or a stretch. An instruction device for transmitting a response medium in a specific area, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device, Corresponding to the first signal, at least two reference positions are generated, and according to the relationship between the at least two reference positions and the reaction medium, for the reaction medium to determine whether to operate. The command device of claim 33, wherein the at least two reference positions constitute one of a geometric figure or a geometric area. The instruction device of claim 33, wherein the action of the reaction medium is to convey the instruction to the reaction medium and to cause the reaction medium to transmit one of the response signals. An instruction device for conveying an instruction to a reaction medium, comprising: an instruction unit configured to transmit a command medium, and accordingly generate at least two reference positions, and according to the at least two reference positions and the reaction medium A relationship for the reaction medium to determine whether to act. An instruction communication method for using the following instruction to a reaction medium, comprising the steps of: providing at least two reference positions in response to a first instruction medium; and: responsive to at least two reference positions and the reaction medium, for The reaction medium determines whether or not to operate. An instruction device for transmitting a response medium in a specific area, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device, A second reference position is generated corresponding to the first signal to form a geometric line, and a relationship is determined between the geometric line and the reaction medium for determining whether to convey the instruction to the reaction medium. The instruction device of claim 38, wherein the relationship is a positional relationship between the geometric line and one of the second regions of the reaction medium in the particular region. The instruction device of claim 39, wherein the positional relationship is whether the geometric line has an intersection relationship with the second area. The instruction device of claim 40, wherein the intersection relationship may be that the geometric line passes through the second area, or the geometric line touches a boundary of the second area. The instruction device of claim 38, wherein the geometric line is a straight line. An instruction device for transmitting a response medium in a specific area, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device, A reference position is temporarily generated corresponding to the first signal, and based on the relationship between the reference position and the reaction medium, for deciding whether to convey the instruction to the reaction medium. The instruction device of claim 43, wherein the reference position is located in the specific area. The instruction device of claim 43, wherein the relationship is the relationship between the reference location and the location of the reaction medium in the particular region. The instruction device of claim 45, wherein the reaction medium forms a second region at the location of the specific region. For example, in the instruction device of claim 43, wherein the term "temporary" refers to between 0.1 and 3 seconds. The instruction device of claim 46, wherein the first signal is further generated and a geometric figure is generated at the reference position, and the geometric figure may be a circle, an ellipse, a polygon, for example, a triangle. A rectangle, a pentagon, etc. The instruction device of claim 48 of the patent application determines whether the instruction is communicated to the reaction medium according to whether the geometric pattern at the reference position has an intersection relationship with the second area, that is, overlay, overlap or intersection. The instruction device of claim 46, wherein whether the instruction is communicated to the reaction medium is determined according to whether the reference position is located in the second area. An instruction device as claimed in claim 50, wherein the instruction includes a command message for selecting and changing a representation of the selected reaction medium. For example, in the instruction device of claim 50, wherein the expression mode may be a reverse display, a color change, a length and a width enlargement display, an unequal scale display, a clear flash display, and an interactive color change. Display, or send an audio. An instruction device for transmitting an instruction to a reaction medium, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device corresponding to the first signal And temporarily providing a reference location and determining whether to communicate the instruction to the reaction medium based on the relationship between the reference location and the reaction medium. The instruction device of claim 53, wherein the reaction medium is located in a specific area. The instruction device of claim 54, wherein the reference position is located in the specific area. An instruction device for transmitting an instruction to a reaction medium, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device corresponding to the first signal And temporarily generating a reference signal and determining whether to communicate the instruction to the reaction medium based on the relationship between the reference signal and the reaction medium. The instruction device of claim 56, wherein the reference signal is one of a location and a region. The instruction device of claim 56, wherein the relationship is established by whether the first location or the first region and the second location or a second region where the reaction medium is located have an intersection relationship, that is, overlap each other. , covering or intersecting. For example, the instruction device of claim 56, wherein the corresponding device sends an indication signal according to the establishment of the relationship, so that the instruction device generates different audio, optical frequency or vibration frequency. An instruction device for transmitting an instruction to a reaction medium, comprising: a sensing unit, sensing a first instruction medium, and generating a corresponding one of the first signals; and a corresponding device corresponding to the first signal A reference parameter is temporarily generated, and based on the relationship between the reference parameter and the reaction medium, for the reaction medium to determine whether to operate. The instruction device of claim 60, wherein the reference parameter is selected from the group consisting of a reference position, a reference geometry, a geometric region, and a reference signal. The instruction device of claim 60, wherein the action of the reaction medium is one of conveying the instruction to the reaction medium and causing the reaction medium to transmit a response signal. An instruction device for conveying an instruction to a reaction medium, comprising: an instruction unit configured to send a command medium, and temporarily generating a reference parameter, and according to the relationship between the reference parameter and the reaction medium For the reaction medium to decide whether to operate. An instruction communication method for using the following instruction to a reaction medium, comprising the steps of: temporarily providing a reference parameter in response to a first instruction medium; and determining a relationship between the reference parameter and the reaction medium for the reaction The medium decides whether or not to act. An instruction device for transmitting an icon in an image area, comprising: an instruction unit configured to perform a first motion to convert the first motion into a first trajectory, and Determining a first region of the image region and determining whether to convey the instruction to the icon based on a relationship between the first region and a second region of the image region displayed in the image region. The command device of claim 65, wherein the command unit comprises: a motion sensing unit that converts the first motion into a first signal; and a processing unit that converts the first signal into the first track, Determining the first region according to the first trajectory, and determining whether to transmit the instruction to the icon according to the first region and the second region. The command device of claim 66, wherein the motion sensing unit comprises: a gyroscope that senses the first motion to generate the first signal. The command device of claim 66, wherein the motion sensing unit comprises: a gyroscope having at least two sensing degrees of freedom, sensing the first motion to generate a first portion of the first signal; An accelerometer having at least two degrees of freedom sensing the first motion to produce a second portion of the first signal. The instruction device of claim 66, wherein the processing unit comprises a microcontroller (Microcontroller) or a microprocessor (Microprocessor) or a digital signal processor (Digital Signal Processor) or a central processing unit. (CPU). The command device of claim 65, wherein: the first motion is formed by one hand driving the command unit; and the first motion comprises at least one of a three-dimensional motion and a two-dimensional motion. The instruction device of claim 65, wherein: the first track comprises at least one of a first arc, a second arc and a first line segment, and a plurality of second line segments; and When the first trajectory is the first arc, the arc angle of the first arc is 360°, which is close to 360. With one of more than 360°. The command device of claim 65, wherein the first region comprises a closed region. The instruction device of claim 65, wherein when the relationship of the first area with respect to the second area is an intersection relationship, that is, partially overlapping, completely overlapping, completely covering, or the centroid of the first area is located In the second area, and when the first track passes, contacts one of the second area, etc., the command unit communicates the instruction to the icon. The instruction device of claim 65, wherein the instruction unit determines that the instruction is after the icon, the icon is selected; and thereafter, the instruction unit is configured to have a second motion, converting the second The motion is a second trajectory, and according to the second trajectory, it is determined whether a preset function of the icon is executed. The command device of claim 74, wherein the second track is one of a hook shape, a fork shape and a circle shape. The instruction device of claim 74, wherein the instruction unit determines that the icon is selected, the command unit is configured to have a second motion, and analyzes an acceleration and deceleration distribution of the second motion to determine the icon. Whether a preset function is executed. The instruction device of claim 76, wherein the second motion is one of a tick, a cross, a wavy, a triangle, an arc, and a circle. An instruction device for conveying a reaction medium in a specific area, comprising: an instruction unit configured to perform a first motion to convert the first motion into a first trajectory, and Determining a first region of the image region and displaying a second region in the particular region based on the first region and the reaction medium for determining whether to communicate the instruction to the reaction medium. An instruction device for conveying a response medium in a specific area, comprising: an instruction unit configured to send a command medium, and temporarily providing a reference position, and according to the reference position A relationship of the reaction medium for determining whether to convey the instruction to the reaction medium. The instruction device of claim 79, wherein: the instruction medium is a motion; the motion is converted into a signal; the signal is converted into the reference position; and the relationship is the reference position and the reaction medium is in the specific area The relationship between the locations. The instruction device of claim 79, wherein the relationship of the position is that when the reference position is in a relevant area of the reaction medium, the instruction is communicated to the reaction medium. The instruction device of claim 81, wherein the reference position, for example, the reference position may be a center point, the geometric figure may be a circle, an ellipse, a polygon, For example, a triangle, a rectangle, a pentagon, and the like. For example, the instruction device of claim 82 determines whether the instruction is communicated to the reaction medium according to whether the geometric pattern overlaps or intersects with the relevant area area. For example, the instruction device of claim 79, wherein the term "temporary" refers to between 0.1 and 3 seconds. An instruction device for conveying an instruction to a reaction medium, comprising: an instruction unit configured to transmit a command medium, and thereby temporarily generating a reference signal, and according to the relationship between the reference signal and the reaction medium For deciding whether to convey the instruction to the reaction medium. The instruction device of claim 85, wherein the reference signal is one of a location and a region. For example, in the instruction device of claim 86, a geometric shape or a contour shape corresponding to the region produces a geometric shape similar to the geometric shape or the contour contour, such as a circle, an ellipse, a rectangle, A triangle, or a polygon. An instruction communication method, using the following instruction to map an icon in an image area, comprising the steps of: converting a first motion into a first track; and determining, according to the first track, a first in the image area And determining, according to the first region, a relationship between the first region and the second region of the image region for determining whether to convey the instruction to the icon. An instruction communication method for using one of the following instructions for a reaction medium in a specific area, comprising the steps of: generating at least three reference positions in response to a first motion; generating a first region in response to the three reference positions; The relationship between the first region and the reaction medium is shown in one of the second regions of the particular region for determining whether to communicate the instruction to the reaction medium. The method of claim 89, wherein the specific area is an image area; wherein the reaction medium is an icon; and the first area is located in the image area. An instruction communication method for using one of the following instructions for a reaction medium in a specific area, comprising the steps of: generating two reference positions in response to a first motion to form a geometric line; and corresponding geometric lines and the reaction medium A relationship in one of the second regions of the particular region is displayed for determining whether to communicate the instruction to the reaction medium. For example, the instruction conveying method of claim 91, wherein the geometric line is a straight line. An instruction communication method for using a command to generate a reference position in response to a first motion; and a relationship between the reference position and the reaction medium for deciding whether to convey The instruction is in the reaction medium. The method of claim 93, wherein the reaction medium is located in a specific area; the reference position is located in the specific area, and forms a first area; and the reaction medium is located in the specific area, and Forming a second area. An instruction communication method for using a following instruction to a reaction medium, comprising the steps of: temporarily providing a reference signal in response to a first instruction medium; and determining whether the reference signal is related to the reaction medium for determining whether The instruction is communicated to the reaction medium. The method of claim 95, wherein the instruction medium is a first motion; the reference signal is a first position signal; and the temporary means that the signal occurs between 0.1 and 3 seconds. The method for transmitting the command of claim 96 further includes the steps of: converting the first motion to a first signal; and converting the first position signal to the first trajectory. The instruction transmitting method of claim 97, further comprising the steps of: starting the first motion; initializing a reference point of the first trajectory; associating the posture of the first motion to perform correction and compensation of the reference point. The method of claim 96, wherein the reaction medium is located in a specific area; the first position signal is located in the specific area and forms a first area; and the reaction medium is located in the specific area And form a second area. The method for transmitting instructions according to claim 99, further comprising the steps of: partially overlapping, completely overlapping, completely covering, and centroid of the first region when the relationship of the first region relative to the second region is located at the first In one of the two regions, the instruction is communicated to the reaction medium. The method of claim 95, wherein the instruction is conveyed to the reaction medium, and the reaction medium is in a functional execution preparatory state, the method further comprising the steps of: converting a second motion to a second a track; and determining, according to the second track, whether a predetermined function of the reaction medium is performed. An instruction device for transmitting an instruction to a first reaction medium, comprising: a first response unit for generating a signal according to a command medium; and a second response unit for generating at least two position references according to the signal And determining, according to the relationship between the first reaction medium and the at least two position reference, whether to communicate the instruction to the first reaction medium. An instruction device for conveying an instruction to a first reaction medium, comprising: an instruction unit configured to send a command medium to generate at least two reference signals, and according to the at least two reference signals and the first reaction medium A relationship for determining whether to communicate the instruction to the first reaction medium. An instruction device for transmitting an instruction to a first reaction medium, comprising: a first response unit that generates a signal according to a command medium; and a second response unit that temporarily generates a group according to the signal a reference parameter, a position reference and a reference signal, and according to the first reaction medium and a relationship from the reference parameter, the position reference and the selected one of the reference signals, for determining whether to convey The instruction is in the first reaction medium. An instruction device for transmitting an instruction to a first reaction medium, comprising: a notification unit for generating a corresponding signal according to a command medium; and a response unit for generating a set of reference parameters corresponding to the signal And a position reference and a reference signal, and according to the first reaction medium and a relationship from the reference parameter, the position reference and the selected one of the reference signals, for determining whether to convey the instruction The first reaction medium.