CN112328080A - Intelligent electronic equipment control instruction generation method, system, device and medium - Google Patents
Intelligent electronic equipment control instruction generation method, system, device and medium Download PDFInfo
- Publication number
- CN112328080A CN112328080A CN202011246027.0A CN202011246027A CN112328080A CN 112328080 A CN112328080 A CN 112328080A CN 202011246027 A CN202011246027 A CN 202011246027A CN 112328080 A CN112328080 A CN 112328080A
- Authority
- CN
- China
- Prior art keywords
- intelligent electronic
- control instruction
- action
- instruction
- finger
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000009471 action Effects 0.000 claims abstract description 98
- 210000000707 wrist Anatomy 0.000 claims abstract description 49
- 230000033001 locomotion Effects 0.000 claims description 72
- 238000004590 computer program Methods 0.000 claims description 17
- 238000005096 rolling process Methods 0.000 claims description 12
- 238000006073 displacement reaction Methods 0.000 claims description 8
- 238000003860 storage Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 7
- 230000005057 finger movement Effects 0.000 claims description 7
- 230000003993 interaction Effects 0.000 abstract description 10
- 238000000926 separation method Methods 0.000 abstract description 2
- 210000003811 finger Anatomy 0.000 description 53
- 241000699666 Mus <mouse, genus> Species 0.000 description 41
- 230000000875 corresponding effect Effects 0.000 description 20
- 230000006870 function Effects 0.000 description 18
- 210000003813 thumb Anatomy 0.000 description 7
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- 241000699670 Mus sp. Species 0.000 description 4
- 230000007547 defect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000005672 electromagnetic field Effects 0.000 description 4
- 238000005034 decoration Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 210000005224 forefinger Anatomy 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method, a system, a device and a medium for generating a control instruction of intelligent electronic equipment, which relate to the field of intelligent interaction and are characterized in that a first terminal is worn on a first finger of a user; the second terminal is worn on the wrist of the user, and an inertial sensor used for detecting the wrist action is installed in the second terminal; the method comprises the following steps: recognizing a first finger action, and generating a first control instruction based on the first finger action; identifying a wrist action, and generating a second control instruction based on the wrist action; the intelligent electronic equipment control instruction is generated based on the first control instruction and/or the second control instruction, so that the interaction efficiency of the mouse can be realized, the carrying is convenient, the air separation operation can be realized, and the naturalness of the gesture operation can be met.
Description
Technical Field
The invention belongs to the field of intelligent interaction, and particularly relates to a method, a system, a device and a medium for generating a control instruction of intelligent electronic equipment.
Background
At present, most of the traditional man-machine interaction modes of electronic products are mice (including desktop mice, air-borne mice and electromagnetic field-based bracelet mice). In recent years, many gesture recognition interaction methods based on optics and inertia have appeared to solve the natural nature of interaction. The mouse is used as a traditional interactive mode, and the interactive input mode is rapid and accurate. But its disadvantage is also magnified due to the change of the display mode. Such as the need for smooth surface operation, the need for moving or holding the mouse, the need for constant button pressing, and poor portability. Resulting in many difficulties in human-computer interaction such as cell phones, AR, VR, television, tablet, etc. Therefore, the method of using more natural hand motions to realize human-computer interaction in the air gesture operation is born because the air gesture operation does not need (or wears little) things. At present, more applications appear in AR, VR, television and mobile phones. But as the application increases, the operation disadvantage of the method also gradually appears. The operation of the spaced gesture is difficult to realize complex operation (such as accurate movement of a cursor), the gesture action is too complex, the hand needs to be operated at a certain position, the operation action amplitude is large, a user is easy to fatigue, a certain recognition rate is caused by the technology, and misoperation is easy to realize. In addition, the operation efficiency is too low compared with the mouse.
CN210324124U discloses a bracelet formula mouse based on alternating electromagnetic field among the prior art, and this mouse can catch human finger and remove, then changes into the removal of mouse cursor, recycles the operation of accomplishing mouse left button and right button at the touch button of watchband side, and then realizes the removal and the click operation of mouse. The use mode is as follows: the hand-held hand is worn on the hand of the user, the hand ring body is located on the back of the hand, the light touch key is located at the convenient touch position of the thumb, and then the corresponding key function of the mouse can be realized through the combination of the touch key and the finger action.
However, the above bracelet-type mouse has the following problems:
firstly, the method comprises the following steps: the bracelet-type mouse is provided with keys, and the corresponding keys are required to be pressed to realize the functions when the corresponding mouse functions are realized, so that the operation of a user is inconvenient;
secondly, the method comprises the following steps: above-mentioned bracelet formula mouse the position of wearing of bracelet end need be worn in back of the hand department when using, and the light touch key position is located the thumb side, and this leads to the user to wear alone when using, uses the palm for pleasing to the eye and convenience of customers, need take off the bracelet end of wearing on the back of the hand when not using, and the wearing mode and position are not reasonable.
Thirdly, the method comprises the following steps: in order to realize the complex function of the mouse, a plurality of fingers are required to wear the ring, and corresponding functions are realized by moving different rings in a matching way, so that the fingers of a user wear too many rings, which is not beneficial to actual operation and use.
Disclosure of Invention
In order to solve the problems in the background art, the invention provides a method, a system, a device and a medium for generating a control instruction of an intelligent electronic device.
In order to achieve the purpose, the invention provides an intelligent electronic device control instruction generation method, which comprises a first terminal worn on a first finger of a user; the second terminal is worn on the wrist of the user, and an inertial sensor used for detecting the wrist action is installed in the second terminal; the method comprises the following steps:
recognizing a first finger action, and generating a first control instruction based on the first finger action;
identifying a wrist action, and generating a second control instruction based on the wrist action;
and generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction.
The present invention is based on the improvement of CN210324124U, the technical solution of CN210324124U has the problems described in the background art, the basic principle of the present invention is to use an electromagnetic capturing system, such as the description of human body motion capturing method and system in patent CN201711258283.x and patent CN201711259701.7, and apply the corresponding system to the device or system, such as installing 2 types of electromagnetic field radiators in the ring body, installing 1 type of electromagnetic field radiators in the bracelet body, and capturing the movement of human fingers by using the method and system in the above 2 patents, but the technical solution of CN210324124U requires multiple fingers to wear the ring simultaneously in real time and the bracelet end needs to be worn above the palm so that the thumb presses the key located at the thumb side. See application No. 2020303609830 for a specific embodiment that requires a thumb to press a corresponding key to perform an existing function.
The technical scheme of the invention is different from the technical scheme of CN210324124U to the greatest extent:
firstly, the method comprises the following steps: the wearing position of the second terminal is that the second terminal is worn on the wrist of a user, so that the defect of wearing the second terminal on the back of the hand is overcome, the wearing habit of people is met, the second terminal does not need to be taken down when not used, and the second terminal can be used as a decoration to avoid the defect of wearing the second terminal on the back of the hand.
Secondly, the method comprises the following steps: the second terminal is not provided with the operation keys, all functions are realized through the gesture of the fingers and the gesture recognition of the wrist, the operation keys are omitted, other fingers are not needed to press the operation keys, the operation keys are not needed to be worn on the back of the hand, the thumb is not needed to press the corresponding keys, the operation is simpler and more convenient, and the operation efficiency is improved.
Thirdly, the method comprises the following steps: the invention only has one first terminal, namely only one ring end, and is realized by operation of a plurality of fingers without realizing complex functions like the technical scheme of CN210324124U, and the invention is realized by only using one ring end to match with corresponding operation gestures, thereby avoiding use troubles and operation troubles caused by wearing a plurality of rings, improving the operation efficiency and the use efficiency and experience of users, and realizing more humanized design.
Preferably, in the method, when the second terminal recognizes that the wrist of the user makes a first preset action, a trigger cursor movement instruction is generated, that is, the first preset action can trigger the movement of the cursor, so that the cursor is in a movable state, and the position of the cursor can be conveniently adjusted according to the finger gesture of the user;
the intelligent electronic equipment receives a trigger cursor movement instruction to control the cursor to be in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
the intelligent electronic device moves the cursor in the unlocked state based on the cursor movement instruction.
Preferably, the first action information in the method includes: direction of motion, velocity and displacement; the cursor movement instruction comprises the movement direction and the displacement of the cursor, the first action can be accurately judged by limiting the specific information of the first action, misoperation is avoided, and accurate movement control of the cursor can be realized through the accurate first action.
Preferably, in addition to the cursor moving function, the method can also realize the corresponding key and wheel operating functions similar to a mouse, and when the cursor moves to a preset position:
detecting whether the first finger makes a preset action, if the preset action meeting the preset requirement is made, generating a mouse button control instruction or a mouse roller control instruction, and sending the mouse button control instruction or the mouse roller control instruction to the intelligent electronic equipment.
Preferably, in the method, when it is detected that the first finger makes a second preset action and the second preset action meets the first preset requirement, a left mouse click command is generated and sent to the intelligent electronic device;
when the first finger is detected to make a third preset action and the third preset action meets a second preset requirement, generating a right mouse click command and sending the right mouse click command to the intelligent electronic equipment;
when the first finger is detected to make a fourth preset action, and the fourth preset action meets a third preset requirement, generating a mouse roller upward rolling instruction, and sending the mouse roller upward rolling instruction to the intelligent electronic equipment;
and when the fifth preset action of the first finger is detected and meets the fourth preset requirement, generating a downward rolling instruction of the mouse roller, and sending the downward rolling instruction of the mouse roller to the intelligent electronic equipment.
Preferably, the method can also realize the dragging function of the target through corresponding action recognition, and after the cursor moves to a preset position:
when detecting that the first finger makes a sixth preset action and the sixth preset action meets a fifth preset requirement, generating a dragging selection instruction and sending the dragging selection instruction to the intelligent electronic equipment;
the intelligent electronic equipment selects a target needing to be dragged corresponding to the cursor based on a dragging selection instruction;
then the second terminal recognizes that the wrist of the user makes a first preset action, and generates a trigger cursor movement instruction;
the intelligent electronic equipment receives a trigger cursor movement instruction, so that the cursor is in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
and the intelligent electronic equipment drags the target to a corresponding position based on the cursor movement instruction.
Preferably, the starting mode of the first terminal and the second terminal in the method is as follows: the first terminal is provided with a power switch, when the power switch is turned on, the first terminal sends a preset starting instruction to the second terminal, and the second terminal starts a working program based on the preset starting instruction.
The invention also provides an intelligent electronic device control instruction generation system, which comprises:
the first terminal is worn on a first finger of a user and used for obtaining action information of the first finger;
the second terminal is worn on the wrist of the user, an inertial sensor used for detecting wrist movement is installed in the second terminal, the second terminal is used for recognizing the first finger movement, and a first control instruction is generated based on the first finger movement; the wrist motion is recognized, and a second control instruction is generated based on the wrist motion; generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction;
and the communication unit is used for establishing communication connection with the intelligent electronic equipment.
The system can generate the function of the control instruction of the intelligent electronic equipment, and transmits the corresponding instruction to the corresponding intelligent electronic equipment through the communication unit.
The invention also provides an intelligent electronic device control instruction generating device, which comprises a memory, a processor and a computer program which is stored in the memory and can run on the processor, wherein the steps of the intelligent electronic device control instruction generating method are realized when the processor executes the computer program.
The present invention also provides a computer-readable storage medium storing a computer program which, when executed by a processor, implements the steps of the intelligent electronic device control instruction generation method.
One or more technical schemes provided by the invention at least have the following technical effects or advantages:
the wearing position of the second terminal is that the second terminal is worn on the wrist of a user, so that the defect of wearing the second terminal on the back of the hand is overcome, the wearing habit of people is met, the second terminal does not need to be taken down when not used, and the second terminal can be used as a decoration to avoid the defect of wearing the second terminal on the back of the hand.
The second terminal is not provided with the operation keys, all functions are realized through the gesture of the fingers and the gesture recognition of the wrist, the operation keys are omitted, other fingers are not needed to press the operation keys, the operation keys are not needed to be worn on the back of the hand, the thumb is not needed to press the corresponding keys, the operation is simpler and more convenient, and the operation efficiency is improved.
The invention only has one first terminal, and is realized by using a plurality of fingers without realizing complex functions, and the invention only uses one ring end to be matched with corresponding operation gestures, thereby avoiding the use trouble and operation trouble caused by wearing a plurality of rings, improving the operation efficiency and the use efficiency and experience of users, and realizing better humanized design.
Drawings
The accompanying drawings, which are included to provide a further understanding of the embodiments of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention;
FIG. 1 is a schematic flow chart of a method for generating control commands for an intelligent electronic device;
fig. 2 is a schematic view of the wearing manner of the first terminal and the second terminal in the method;
FIG. 3 is a logic diagram illustrating the operation of the method;
fig. 4 is a schematic diagram of the intelligent electronic device control instruction generation system.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention will be rendered by reference to the appended drawings. It should be noted that the embodiments of the present invention and features of the embodiments may be combined with each other without conflicting with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced in other ways than those specifically described and thus the scope of the present invention is not limited by the specific embodiments disclosed below.
It will be understood by those skilled in the art that in the present disclosure, the terms "longitudinal," "lateral," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," and the like are used in an orientation or positional relationship indicated in the drawings for ease of description and simplicity of description, and do not indicate or imply that the referenced devices or components must be constructed and operated in a particular orientation and thus are not to be considered limiting.
It is understood that the terms "a" and "an" should be interpreted as meaning that a number of one element or element is one in one embodiment, while a number of other elements is one in another embodiment, and the terms "a" and "an" should not be interpreted as limiting the number.
Example one
Referring to fig. 1, fig. 1 is a schematic flow chart of a method for generating a control command of an intelligent electronic device, in which a first terminal worn on a first finger of a user according to a first embodiment of the present invention provides a method for generating a control command of an intelligent electronic device; the second terminal is worn on the wrist of the user, and an inertial sensor used for detecting the wrist action is installed in the second terminal; the intelligent electronic device in this embodiment may be a mobile phone, a tablet, an intelligent watch, a computer, a game machine, and the like, and the specific form of the intelligent electronic device is not limited in the present invention.
The method comprises the following steps:
recognizing a first finger action, and generating a first control instruction based on the first finger action;
identifying a wrist action, and generating a second control instruction based on the wrist action;
and generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction.
In the embodiment of the invention, when the second terminal recognizes that the wrist of the user makes a first preset action, a trigger cursor movement instruction is generated;
the intelligent electronic equipment receives a trigger cursor movement instruction to control the cursor to be in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
the intelligent electronic device moves the cursor in the unlocked state based on the cursor movement instruction.
In an embodiment of the present invention, the first action information in the method includes: direction of motion, velocity and displacement; the cursor movement command includes a movement direction and a displacement of the cursor.
The first action may be a left movement or a right movement of the finger, or may be other actions, and the moving speed may be adjusted according to actual needs, which is not limited in the present invention.
Wherein the wrist movement may be a wrist shake or turn or other movement, and the invention is not limited to the specific movement.
In the embodiment of the present invention, after the cursor moves to the preset position:
detecting whether the first finger makes a preset action, if the preset action meeting the preset requirement is made, generating a mouse button control instruction or a mouse roller control instruction, and sending the mouse button control instruction or the mouse roller control instruction to the intelligent electronic equipment.
In the embodiment of the invention, when the first finger is detected to make a second preset action and the second preset action meets the first preset requirement, a mouse left button clicking instruction is generated and sent to the intelligent electronic equipment; the second preset action may be left movement of the first finger, and the first preset requirement may be a movement speed of the first finger, where a specific implementation form of the second preset action and a specific requirement form of the first preset requirement are not specifically limited in this embodiment;
when the first finger is detected to make a third preset action and the third preset action meets a second preset requirement, generating a right mouse click command and sending the right mouse click command to the intelligent electronic equipment; the third preset action may be the right movement of the first finger, and the second preset requirement may be the movement speed of the first finger, where the specific implementation form of the third preset action and the specific requirement form of the second preset requirement are not specifically limited in this embodiment;
when the first finger is detected to make a fourth preset action, and the fourth preset action meets a third preset requirement, generating a mouse roller upward rolling instruction, and sending the mouse roller upward rolling instruction to the intelligent electronic equipment; the fourth preset action may be that the first finger moves up and then moves down, and the third preset requirement may be the moving speed and direction of the first finger, where the specific implementation form of the fourth preset action and the specific requirement form of the third preset requirement are not specifically limited in this embodiment;
and when the fifth preset action of the first finger is detected and meets the fourth preset requirement, generating a downward rolling instruction of the mouse roller, and sending the downward rolling instruction of the mouse roller to the intelligent electronic equipment. The fifth preset action may be that the first finger moves downwards and then moves upwards, and the fourth preset requirement may be the moving speed and direction of the first finger, where the specific implementation form of the fifth preset action and the specific requirement form of the fourth preset requirement are not specifically limited in this embodiment;
in the embodiment of the present invention, after the cursor moves to the preset position:
when detecting that the first finger makes a sixth preset action and the sixth preset action meets a fifth preset requirement, generating a dragging selection instruction and sending the dragging selection instruction to the intelligent electronic equipment; the sixth preset action may be wrist shake, and the fifth preset requirement may be a speed of the wrist shake, where a specific implementation form of the sixth preset action and a specific requirement form of the fifth preset requirement are not specifically limited in this embodiment;
the intelligent electronic equipment selects a target needing to be dragged corresponding to the cursor based on a dragging selection instruction;
then the second terminal recognizes that the wrist of the user makes a first preset action, and generates a trigger cursor movement instruction;
the intelligent electronic equipment receives a trigger cursor movement instruction, so that the cursor is in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
and the intelligent electronic equipment drags the target to a corresponding position based on the cursor movement instruction.
In the embodiment of the invention, the first terminal is provided with the power switch, when the power switch is turned on, the first terminal sends the preset starting instruction to the second terminal, and the second terminal starts the working program based on the preset starting instruction.
The embodiment provides an interaction method and a product, which can realize the interaction efficiency of a mouse, are convenient to carry, can perform air separation operation and can meet the naturalness of gesture operation.
The scheme uses a patent CN201711258283.X and a patent CN201711259701.7 to capture the human body motion and a system thereof. Human finger movement is captured and then translated into movement of the mouse cursor. And secondly, adding an inertial sensor in the bracelet main body, and detecting the movement of the wrist by using the inertial sensor. The detected specific motion is used as a trigger signal for cursor movement. And thirdly, converting the action of the finger into a cursor movement stop and a corresponding operation instruction by using an innovative operation method, wherein the whole operation is converted from the natural action of the finger without the assistance of a physical key. And fourthly, the wearing mode can be that the wrist strap and the finger wear the ring. The product conforms to the wearing habits of daily products of people and can be used as a decorative article daily.
Fig. 2 is a schematic view of a wearing manner of a first terminal and a second terminal in the method, where the first terminal is a ring terminal and the second terminal is a bracelet terminal.
By wearing wrist-watch (or bracelet) on the wrist with wear ring two parts on the finger and constitute (ring switch is used for starting the ring power, can send the signal for the wrist-watch after the ring power starts, the wrist-watch detects back automatic start working procedure).
The method comprises the following specific operations: the wrist watch is internally provided with an inertial sensor which can detect the movement of the wrist so that the wrist can rapidly move up and down (or left and right) back and forth to trigger the movement of the cursor. Then the forefinger moves up and down and left and right to drive the ring to move. At the moment, the built-in sensor of the watch detects information such as direction, speed, displacement and the like of the ring. And converting the mouse cursor into the corresponding direction, moving speed and moving displacement of the mouse cursor. Thereby enabling real-time cursor movement. After the cursor is moved to a desired position, the following operation logic is implemented, and the specific operation logic may refer to fig. 3, where fig. 3 is a schematic diagram of the specific operation logic of the method.
Compared with the technical scheme of CN210324124U, the embodiment has the following advantages:
1. the hardware of pure gesture operation is realized without keys. 2. Because the keys are not needed, the wearing position is changed greatly, and the palm is changed into two positions which are more suitable for being worn by a human body, namely the wrist and the fingers. 3. The improvement of the method of gesture operation enables the 2 points above to be realized. 4. The user can realize gesture operation by hands in any posture.
Example two
Referring to fig. 4, fig. 4 is a schematic diagram illustrating a control instruction generating system of an intelligent electronic device, an embodiment of the present invention provides an intelligent electronic device control instruction generating system, including:
the first terminal is worn on a first finger of a user and used for obtaining action information of the first finger;
the second terminal is worn on the wrist of the user, an inertial sensor used for detecting wrist movement is installed in the second terminal, the second terminal is used for recognizing the first finger movement, and a first control instruction is generated based on the first finger movement; the wrist motion is recognized, and a second control instruction is generated based on the wrist motion; generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction;
and the communication unit is used for establishing communication connection with the intelligent electronic equipment.
EXAMPLE III
The third embodiment of the present invention further provides an intelligent electronic device control instruction generating apparatus, which includes a memory, a processor, and a computer program that is stored in the memory and is executable on the processor, and when the processor executes the computer program, the steps of the intelligent electronic device control instruction generating method are implemented.
The processor may be a Central Processing Unit (CPU), or other general-purpose processor, a digital signal processor (digital signal processor), an Application Specific Integrated Circuit (Application Specific Integrated Circuit), an off-the-shelf programmable gate array (field programmable gate array) or other programmable logic device, a discrete gate or transistor logic device, a discrete hardware component, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory can be used for storing the computer program and/or the module, and the processor can realize various functions of the intelligent electronic device control instruction generating device in the invention by operating or executing the data stored in the memory. The memory may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like. Further, the memory may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a smart memory card, a secure digital card, a flash memory card, at least one magnetic disk storage device, a flash memory device, or other volatile solid state storage device.
Example four
The fourth embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps of the method for generating the control instruction of the intelligent electronic device are implemented.
The intelligent electronic device control instruction generating means, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on such understanding, all or part of the flow in the method of implementing the embodiments of the present invention may also be stored in a computer readable storage medium through a computer program, and when the computer program is executed by a processor, the computer program may implement the steps of the above-described method embodiments. Wherein the computer program comprises computer program code, an object code form, an executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying said computer program code, a recording medium, a usb-disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a read-only memory, a random access memory, a point carrier signal, a telecommunications signal, a software distribution medium, etc. It should be noted that the computer readable medium may contain content that is appropriately increased or decreased as required by legislation and patent practice in the jurisdiction.
While preferred embodiments of the present invention have been described, additional variations and modifications in those embodiments may occur to those skilled in the art once they learn of the basic inventive concepts. Therefore, it is intended that the appended claims be interpreted as including preferred embodiments and all such alterations and modifications as fall within the scope of the invention.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A method for generating a control instruction of intelligent electronic equipment is characterized in that a first terminal is worn on a first finger of a user; the second terminal is worn on the wrist of the user, and an inertial sensor used for detecting the wrist action is installed in the second terminal; the method comprises the following steps:
recognizing a first finger action, and generating a first control instruction based on the first finger action;
identifying a wrist action, and generating a second control instruction based on the wrist action;
and generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction.
2. The intelligent electronic device control instruction generation method according to claim 1,
when the second terminal recognizes that the wrist of the user makes a first preset action, generating a trigger cursor movement instruction;
the intelligent electronic equipment receives a trigger cursor movement instruction to control the cursor to be in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
the intelligent electronic device moves the cursor in the unlocked state based on the cursor movement instruction.
3. The intelligent electronic device control instruction generation method according to claim 2, wherein the first action information includes: direction of motion, velocity and displacement; the cursor movement command includes a movement direction and a displacement of the cursor.
4. The intelligent electronic device control instruction generation method according to claim 2, wherein after the cursor is moved to a preset position:
detecting whether the first finger makes a preset action, if the preset action meeting the preset requirement is made, generating a mouse button control instruction or a mouse roller control instruction, and sending the mouse button control instruction or the mouse roller control instruction to the intelligent electronic equipment.
5. The intelligent electronic device control instruction generation method according to claim 4, wherein when it is detected that the first finger makes a second preset action and the second preset action meets the first preset requirement, a mouse left button click instruction is generated and sent to the intelligent electronic device;
when the first finger is detected to make a third preset action and the third preset action meets a second preset requirement, generating a right mouse click command and sending the right mouse click command to the intelligent electronic equipment;
when the first finger is detected to make a fourth preset action, and the fourth preset action meets a third preset requirement, generating a mouse roller upward rolling instruction, and sending the mouse roller upward rolling instruction to the intelligent electronic equipment;
and when the fifth preset action of the first finger is detected and meets the fourth preset requirement, generating a downward rolling instruction of the mouse roller, and sending the downward rolling instruction of the mouse roller to the intelligent electronic equipment.
6. The intelligent electronic device control instruction generation method according to claim 2, wherein after the cursor is moved to a preset position:
when detecting that the first finger makes a sixth preset action and the sixth preset action meets a fifth preset requirement, generating a dragging selection instruction and sending the dragging selection instruction to the intelligent electronic equipment;
the intelligent electronic equipment selects a target needing to be dragged corresponding to the cursor based on a dragging selection instruction;
then the second terminal recognizes that the wrist of the user makes a first preset action, and generates a trigger cursor movement instruction;
the intelligent electronic equipment receives a trigger cursor movement instruction, so that the cursor is in an unlocking state;
the method comprises the steps of identifying first action information of a first finger of a user, generating a cursor movement instruction based on the first action information, and transmitting the cursor movement instruction to the intelligent electronic equipment;
and the intelligent electronic equipment drags the target to a corresponding position based on the cursor movement instruction.
7. The method according to claim 1, wherein a power switch is disposed on the first terminal, and when the power switch is turned on, the first terminal sends a preset start command to the second terminal, and the second terminal starts the working program based on the preset start command.
8. An intelligent electronic device control instruction generation system, the system comprising:
the first terminal is worn on a first finger of a user and used for obtaining action information of the first finger;
the second terminal is worn on the wrist of the user, an inertial sensor used for detecting wrist movement is installed in the second terminal, the second terminal is used for recognizing the first finger movement, and a first control instruction is generated based on the first finger movement; the wrist motion is recognized, and a second control instruction is generated based on the wrist motion; generating an intelligent electronic device control instruction based on the first control instruction and/or the second control instruction;
and the communication unit is used for establishing communication connection with the intelligent electronic equipment.
9. An intelligent electronic device control instruction generating apparatus, comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the intelligent electronic device control instruction generating method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, carries out the steps of the method for generating control instructions for an intelligent electronic device as claimed in any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011246027.0A CN112328080A (en) | 2020-11-10 | 2020-11-10 | Intelligent electronic equipment control instruction generation method, system, device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011246027.0A CN112328080A (en) | 2020-11-10 | 2020-11-10 | Intelligent electronic equipment control instruction generation method, system, device and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112328080A true CN112328080A (en) | 2021-02-05 |
Family
ID=74317347
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011246027.0A Pending CN112328080A (en) | 2020-11-10 | 2020-11-10 | Intelligent electronic equipment control instruction generation method, system, device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112328080A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001236174A (en) * | 2000-02-25 | 2001-08-31 | Fujitsu Ltd | Device for inputting handwritten character and method for recognizing handwritten character |
| US20110080339A1 (en) * | 2009-10-07 | 2011-04-07 | AFA Micro Co. | Motion Sensitive Gesture Device |
| US20140257143A1 (en) * | 2013-03-08 | 2014-09-11 | The Regents of the University of California Corporation, A California Corporation | Systems And Methods For Monitoring Hand And Wrist Movement |
| US20150185852A1 (en) * | 2013-12-30 | 2015-07-02 | Dau-Ning GUO | Ring mobile device and operation method of the same |
| WO2015102175A1 (en) * | 2013-12-30 | 2015-07-09 | (주)유즈브레인넷 | Ring type wireless controller device |
| CN107752174A (en) * | 2017-12-04 | 2018-03-06 | 成都思悟革科技有限公司 | A kind of gloves based on electromagnetic field motion capture technology |
| WO2018058462A1 (en) * | 2016-09-29 | 2018-04-05 | 深圳市柔宇科技有限公司 | Control method, control device and smart wearable apparatus |
| US20180317770A1 (en) * | 2017-05-03 | 2018-11-08 | The Florida International University Board Of Trustees | Wearable device and methods of using the same |
| CN210324124U (en) * | 2019-11-06 | 2020-04-14 | 成都思悟革科技有限公司 | Bracelet formula mouse based on alternating electromagnetic field |
-
2020
- 2020-11-10 CN CN202011246027.0A patent/CN112328080A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001236174A (en) * | 2000-02-25 | 2001-08-31 | Fujitsu Ltd | Device for inputting handwritten character and method for recognizing handwritten character |
| US20110080339A1 (en) * | 2009-10-07 | 2011-04-07 | AFA Micro Co. | Motion Sensitive Gesture Device |
| US20140257143A1 (en) * | 2013-03-08 | 2014-09-11 | The Regents of the University of California Corporation, A California Corporation | Systems And Methods For Monitoring Hand And Wrist Movement |
| US20150185852A1 (en) * | 2013-12-30 | 2015-07-02 | Dau-Ning GUO | Ring mobile device and operation method of the same |
| WO2015102175A1 (en) * | 2013-12-30 | 2015-07-09 | (주)유즈브레인넷 | Ring type wireless controller device |
| WO2018058462A1 (en) * | 2016-09-29 | 2018-04-05 | 深圳市柔宇科技有限公司 | Control method, control device and smart wearable apparatus |
| US20180317770A1 (en) * | 2017-05-03 | 2018-11-08 | The Florida International University Board Of Trustees | Wearable device and methods of using the same |
| CN107752174A (en) * | 2017-12-04 | 2018-03-06 | 成都思悟革科技有限公司 | A kind of gloves based on electromagnetic field motion capture technology |
| CN210324124U (en) * | 2019-11-06 | 2020-04-14 | 成都思悟革科技有限公司 | Bracelet formula mouse based on alternating electromagnetic field |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10126826B2 (en) | System and method for interaction with digital devices | |
| US9360965B2 (en) | Combined touch input and offset non-touch gesture | |
| JP6542262B2 (en) | Multi-device multi-user sensor correlation for pen and computing device interaction | |
| JP6660309B2 (en) | Sensor correlation for pen and touch-sensitive computing device interaction | |
| TWI411935B (en) | System and method for generating control instruction by identifying user posture captured by image pickup device | |
| Taylor et al. | Type-hover-swipe in 96 bytes: A motion sensing mechanical keyboard | |
| CN109933206B (en) | Finger non-contact drawing method and system based on Leap Motion | |
| CN106104421A (en) | A kind of finger ring type wireless finger sense controller, control method and control system | |
| CN105960626A (en) | Grip detection | |
| Matulic et al. | Phonetroller: Visual representations of fingers for precise touch input with mobile phones in vr | |
| CN105589553A (en) | Gesture control method and system for intelligent equipment | |
| WO2016026365A1 (en) | Man-machine interaction method and system for achieving contactless mouse control | |
| CN102789312A (en) | User interaction system and method | |
| US20240077948A1 (en) | Gesture-based display interface control method and apparatus, device and storage medium | |
| CN111596757A (en) | Gesture control method and device based on fingertip interaction | |
| CN102685581B (en) | Multi-hand control system for intelligent television | |
| US20130229348A1 (en) | Driving method of virtual mouse | |
| KR101233793B1 (en) | Virtual mouse driving method using hand motion recognition | |
| KR20160039589A (en) | Wireless space control device using finger sensing method | |
| CN112328080A (en) | Intelligent electronic equipment control instruction generation method, system, device and medium | |
| CN102081494A (en) | Identification method of window sign language vernier control | |
| CN112306242A (en) | Interaction method and system based on book-space gestures | |
| CN210573844U (en) | Wrist skin texture morphological change acquisition equipment and instruction output equipment | |
| US20240185516A1 (en) | A Method for Integrated Gaze Interaction with a Virtual Environment, a Data Processing System, and Computer Program | |
| KR101506197B1 (en) | A gesture recognition input method using two hands |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210205 |