CN211698898U - Human-computer interaction system based on finger gesture is resolved - Google Patents
Human-computer interaction system based on finger gesture is resolved Download PDFInfo
- Publication number
- CN211698898U CN211698898U CN202020024917.6U CN202020024917U CN211698898U CN 211698898 U CN211698898 U CN 211698898U CN 202020024917 U CN202020024917 U CN 202020024917U CN 211698898 U CN211698898 U CN 211698898U
- Authority
- CN
- China
- Prior art keywords
- module
- bluetooth
- human
- gesture
- controller
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
A human-computer interaction system based on finger gesture resolving comprises a gesture acquisition module and a Bluetooth receiving module; the gesture acquisition module is in wireless connection communication with the Bluetooth receiving module; the gesture collection module comprises a first power management module, a first controller module, a sensor module and a first antenna module, the first power management module supplies power to the controller module, the sensor module collects signals and transmits the signals to the controller module, and a communication port of the control module is connected with a first communication port of the first antenna module. The method applies various sensors and attitude calculation algorithms to the field of human-computer interaction, improves the real-time performance and flexibility of interaction compared with the traditional human-computer interaction mode, and greatly optimizes the interaction freedom and the user experience.
Description
Technical Field
The utility model relates to a human-computer interaction field, concretely relates to human-computer interaction system based on finger gesture is resolved.
Background
The utility model discloses a be 201520232075.2 utility model designs a multi-functional wearing formula human-computer interaction input device based on MEMS acceleration sensor, this equipment with the analog signal processing who acceleration sensor output convert the inclination gesture, the rotational angular velocity of user's palm, the running state parameter such as acceleration, transfer corresponding control algorithm to carry out analysis processes to the gesture motion according to the functional mode developments that the operator selected again, realize different input device functions. But the motion state parameters of the hand of the user are obtained only through the acceleration sensor, and the accuracy and the reliability of the method are low.
The utility model discloses a utility model patent application No. 201720184438.9 has designed a human-computer interaction's gesture recognition equipment of pluggable formula, many module combination, and this equipment comprises a main control unit, a set of inertial sensor and an inertial sensor fixed baseplate. The inertial sensor is used for detecting the raw movement information data of the palm and transmitting the data to the main controller. The user can select the quantity of inertial sensor as required, and there are seven micro-USB interfaces on the inertial sensor fixed base for connecting inertial sensor. Although the device has good expandability, the inertial sensor and the main controller are connected in a wired mode, the whole device is complicated, and the experience of a user can be influenced.
The utility model discloses an application number 201620917357.0 has designed a hand-held controller for human-computer interaction, and this equipment includes brake valve lever and hand model, and the user holds brake valve lever in order to carry out human-computer interaction, and the hand model is used for the discernment and the location of device. The gesture sensor built in the control handle can acquire real-time hand gestures, but in use, a user has to hold the control handle, the types of the recognizable hand gestures are limited, and the gestures of fingers cannot be recognized accurately.
SUMMERY OF THE UTILITY MODEL
The utility model discloses to prior art's not enough, provide a human-computer interaction system based on finger gesture is resolved, concrete technical scheme as follows:
a human-computer interaction system based on finger gesture is resolved, which is characterized in that: the system comprises an attitude acquisition module and a Bluetooth receiving module;
the gesture acquisition module is in wireless connection communication with the Bluetooth receiving module;
the attitude acquisition module comprises a first power management module, a first controller module, a sensor module and a first antenna module, wherein the first power management module supplies power to the controller module, the sensor module acquires signals and transmits the signals to the controller module, and a communication port of the control module is connected with a first communication port of the first antenna module;
the Bluetooth receiving module comprises a second power management module, a second controller module, a second antenna module and a serial port communication module;
the second power management module supplies power to the second controller module, a first communication port of the second controller module is connected with the second antenna module, and the second antenna module is wirelessly connected with the first antenna module;
and the control instruction of the second controller module is sent to the external equipment through the serial port communication module.
For better realization the utility model discloses, can further be: the Bluetooth receiving module is installed in a Bluetooth shell (1), the Bluetooth shell (1) is a rectangular shell, a first power indicator lamp (2) and a first Bluetooth connection indicator lamp (3) are arranged on the side face of the Bluetooth shell (1), and a first switch (4) and a first USB interface (5) are arranged at two ends of the Bluetooth shell (1) respectively.
Further: gesture collection module installs in cyclic annular casing (6) the side of cyclic annular casing (6) is provided with visor (7) the side of cyclic annular casing (6) still is provided with second power indicator (8) and second bluetooth connection pilot lamp (9) respectively be provided with key switch (10) and second USB interface (11) on the periphery of cyclic annular casing (6) respectively.
Further: a sponge layer (12) is arranged on the inner wall of the annular shell (6).
The utility model has the advantages that: firstly, various sensors and attitude calculation algorithms are applied to the field of human-computer interaction, the real-time performance and flexibility of interaction are improved compared with the traditional human-computer interaction mode, and the interaction freedom degree and the user experience feeling are greatly optimized.
Secondly, the user is allowed to define a specific man-machine interaction mode in a certain range, the user can effectively interact with the computer in a non-contact mode, the requirements of various application occasions can be met, the man-machine interaction mode is enriched to a certain extent, and the method has wide application prospects in the fields of game entertainment and medical rehabilitation.
Drawings
FIG. 1 is an overall block diagram of the present invention;
FIG. 2 is a view of the Bluetooth housing installation configuration;
FIG. 3 is a view of the installation structure of the attitude acquisition module;
FIG. 4 is a side view of FIG. 3;
FIG. 5 is a second structural diagram of the attitude acquisition module;
FIG. 6 is a flow chart of an attitude algorithm;
in the figure, reference numerals are illustrated that a bluetooth shell 1, a first power indicator 2, a first bluetooth connection indicator 3, a first switch 4, a first USB interface 5, an annular shell 6, a protective cover 7, a second power indicator 8, a second bluetooth connection indicator 9, a key switch 10, a second USB interface 11, and a sponge layer 12.
Detailed Description
The following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings, will make the advantages and features of the invention easier to understand by those skilled in the art, and thus will clearly and clearly define the scope of the invention.
As shown in fig. 1 to 5: a human-computer interaction system based on finger gesture resolving comprises a gesture acquisition module and a Bluetooth receiving module;
the gesture acquisition module is in wireless connection communication with the Bluetooth receiving module;
the attitude acquisition module comprises a first power management module, a first controller module, a sensor module and a first antenna module, wherein the first power management module supplies power to the controller module, the sensor module acquires signals and transmits the signals to the controller module, and a communication port of the control module is connected with a first communication port of the first antenna module;
the Bluetooth receiving module comprises a second power management module, a second controller module, a second antenna module and a serial port communication module;
the second power management module supplies power to the second controller module, a first communication port of the second controller module is connected with the second antenna module, and the second antenna module is wirelessly connected with the first antenna module;
and the control instruction of the second controller module is sent to the external equipment through the serial port communication module.
Wherein, bluetooth receiving module installs in bluetooth shell 1, and bluetooth shell 1 is the rectangle casing, is provided with first power indicator 2 and first bluetooth connection pilot lamp 3 on bluetooth shell 1's side, is provided with first switch 4 and first USB interface 5 respectively at bluetooth shell 1's both ends.
The gesture collection module is installed in annular casing 6, is provided with sponge layer 12 at the inner wall of annular casing 6 for improve and wear the comfort level. The side of the annular shell 6 is provided with a protective cover 7, the protective cover 7 is used for protecting the gesture collection module, the side of the annular shell 6 is also provided with a second power indicator 8 and a second Bluetooth connection indicator 9, the periphery of the annular shell 6 is provided with a key switch 10 and a second USB interface 11, and the second USB interface 11 is used for charging a small lithium battery.
In this embodiment, for convenience of understanding and implementation, the controller module is an nRF52832 chip of Nordic corporation, which is a system on chip (SoC) of Bluetooth Low Energy (Bluetooth Low Energy), has a Cortex-M4F core and a main frequency of 64MHz, and supports various peripheral interfaces such as SPI, I2C, UART, and the like.
The antenna module adopts a PCB antenna design, and snakelike routing is arranged on the PCB according to the standard so as to realize the radio frequency communication function. Compared with a ceramic antenna and a chip antenna, although the PCB antenna occupies a larger space, the design difficulty and the cost are relatively low.
The sensor module uses MPU6050 chip from InvenSense company and BMM150 chip from BOSCH company. The MPU6050 incorporates a three-axis MEMS gyroscope and a three-axis MEMS accelerometer, and an internal 16-bit ADC can convert raw data of the gyroscope and the accelerometer into digital values and output the digital values to a specified device through an I2C interface. The BMM150 chip is a low-power consumption, low-noise three-axis digital geomagnetic sensor, and raw magnetic strength data of XYZ three axes can be read out from corresponding registers through an I2C interface.
The power management module adopts a linear voltage stabilizer with 3.3V output voltage and 250mA output current, such as an LP5907 chip of TI company, and 5V voltage provided by the small lithium battery is converted into power supply voltage and current required by the controller module through the voltage stabilizer. Meanwhile, the power management module also comprises an LTC2950 chip of LINEAR, which is a button turn-off controller with low power consumption and wide voltage input range and is used for realizing the lithium battery charging function in the system. When the voltage of the battery is lower than a certain value, the lithium battery can be charged through the Micro-USB interface.
The Bluetooth receiving module is the same as the controller module, the antenna module, the serial port communication module and the power management module;
the serial port communication module adopts a CP2101 chip of Silicon company, and the CP2101 is a special chip with highly integrated USB-to-UART function and can support two serial communication interface standards of RS-232 and RS-485. Through the chip, information interaction can be carried out between the Bluetooth receiving module and the computer through the USB interface.
The power management module also adopts an LP5907 chip, compared with the attitude acquisition module, the power supply mode of the Bluetooth receiving module is different, and the power supply mode of the USB interface for directly supplying power replaces a lithium battery.
The utility model discloses the principle:
firstly, a user inserts the Bluetooth receiving module into a USB interface of a computer, the USB interface of the computer supplies power to the module, and the first Bluetooth connection indicator lamp is kept normally on to indicate that the Bluetooth receiving module works normally.
Secondly, the user wears the gesture collection module on arbitrary finger and presses key switch for a long time, and the second power indicator keeps bright after showing that the module has normally worked. The second power indicator will flash after the gesture collection module is powered on, and the second Bluetooth connection indicator will keep normally bright after the gesture collection module is connected with the Bluetooth receiving module.
Thirdly, after the gesture collection modules are confirmed to be connected with the Bluetooth receiving module, the system enters a learning mode by long pressing of a key switch of the Bluetooth receiving module, at the moment, a user can make a gesture, the gesture resolving module records gesture information and takes the gesture information as one of instructions for interaction with a computer, the system can record a plurality of gesture information, and the gesture information is reset after the system is restarted.
The gesture information here refers to the change of the posture of the fingers in a short time before and after entering the learning mode, for example, before entering the learning mode, the middle finger of the index finger is in a state of being folded and straightened, specifically, the posture acquisition module is worn on the index finger and the middle finger, after entering the learning mode, the two fingers are folded and bent by 30 degrees in a short time, and then the change of the posture of the fingers is recorded as the gesture information.
After recording at least one instruction, the user can normally interact with the computer. If the user makes a recorded gesture, the gesture acquisition module sends information corresponding to the gesture to the Bluetooth receiving module through a Bluetooth protocol, the Bluetooth receiving module converts the gesture information into a control instruction and sends the control instruction to the computer through a serial port, the computer monitors the corresponding serial port to recognize the gesture currently made by the user, and the computer can perform further control such as webpage browsing, game playing, typing and the like by combining with corresponding software.
The adopted attitude angle algorithm is specifically that the attitude calculation refers to that a controller reads data of a sensor of the controller and calculates an attitude angle in real time, wherein the attitude angle is also an Euler angle, namely a roll angle, a pitch angle and a yaw angle. The system adopts an attitude calculation algorithm based on quaternion, the quaternion is equivalent to an Euler angle and a rotation matrix, but the quaternion representation method has no singular point problem and is more suitable for attitude calculation. The general representation of quaternions is:
q＝q0+q1i+q2j+q3k
the euler angles can be directly represented by quaternions:
nine-axis raw data are acquired from the sensor through an I2C interface, and Euler angles are obtained through a controller.
Claims (4)
1. A human-computer interaction system based on finger gesture is resolved, which is characterized in that: the system comprises an attitude acquisition module and a Bluetooth receiving module;
the gesture acquisition module is in wireless connection communication with the Bluetooth receiving module;
the attitude acquisition module comprises a first power management module, a first controller module, a sensor module and a first antenna module, wherein the first power management module supplies power to the first controller module, the sensor module acquires signals and transmits the signals to the first controller module, and a communication port of the first controller module is connected with a first communication port of the first antenna module;
the Bluetooth receiving module comprises a second power management module, a second controller module, a second antenna module and a serial port communication module;
the second power management module supplies power to the second controller module, a first communication port of the second controller module is connected with the second antenna module, and the second antenna module is wirelessly connected with the first antenna module;
and the control instruction of the second controller module is sent to the external equipment through the serial port communication module.
2. The human-computer interaction system based on finger gesture solution of claim 1, characterized in that: the Bluetooth receiving module is installed in a Bluetooth shell (1), the Bluetooth shell (1) is a rectangular shell, a first power indicator lamp (2) and a first Bluetooth connection indicator lamp (3) are arranged on the side face of the Bluetooth shell (1), and a first switch (4) and a first USB interface (5) are arranged at the two ends of the Bluetooth shell (1) respectively.
3. The human-computer interaction system based on finger gesture solution of claim 1, characterized in that: gesture collection module installs in cyclic annular casing (6) the side of cyclic annular casing (6) is provided with visor (7) the side of cyclic annular casing (6) still is provided with second power indicator (8) and second bluetooth connection pilot lamp (9) respectively be provided with key switch (10) and second USB interface (11) on the periphery of cyclic annular casing (6) respectively.
4. The human-computer interaction system based on finger gesture solution of claim 3, characterized in that: a sponge layer (12) is arranged on the inner wall of the annular shell (6).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020024917.6U CN211698898U (en) | 2020-01-07 | 2020-01-07 | Human-computer interaction system based on finger gesture is resolved |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202020024917.6U CN211698898U (en) | 2020-01-07 | 2020-01-07 | Human-computer interaction system based on finger gesture is resolved |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN211698898U true CN211698898U (en) | 2020-10-16 |
Family
ID=72799357
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202020024917.6U Active CN211698898U (en) | 2020-01-07 | 2020-01-07 | Human-computer interaction system based on finger gesture is resolved |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN211698898U (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113211466A (en) * | 2021-04-27 | 2021-08-06 | 北京科技大学顺德研究生院 | Medical somatosensory robot system based on inertial sensor |
| CN113425291A (en) * | 2021-06-24 | 2021-09-24 | 东北大学秦皇岛分校 | Ring formula collection system based on MEMS sensor |
-
2020
- 2020-01-07 CN CN202020024917.6U patent/CN211698898U/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113211466A (en) * | 2021-04-27 | 2021-08-06 | 北京科技大学顺德研究生院 | Medical somatosensory robot system based on inertial sensor |
| CN113425291A (en) * | 2021-06-24 | 2021-09-24 | 东北大学秦皇岛分校 | Ring formula collection system based on MEMS sensor |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9218058B2 (en) | Wearable digital input device for multipoint free space data collection and analysis | |
| Perng et al. | Acceleration sensing glove (ASG) | |
| US9110505B2 (en) | Wearable motion sensing computing interface | |
| US20110199305A1 (en) | Mouse controlled by movements of fingers in the air | |
| CN102063183A (en) | Virtual input device of grove type | |
| CN211698898U (en) | Human-computer interaction system based on finger gesture is resolved | |
| CN201638148U (en) | Glove-type virtual input device | |
| US20140028547A1 (en) | Simple user interface device and chipset implementation combination for consumer interaction with any screen based interface | |
| CN104898828A (en) | Somatosensory interaction method using somatosensory interaction system | |
| US11042227B2 (en) | Wireless virtual mouse | |
| CN102478959A (en) | Control system and method for electronic device | |
| US12045395B2 (en) | Wearable device and method for detecting motion gesture of wearable device | |
| CN104898827A (en) | Somatosensory interaction method applying somatosensory interaction system | |
| US10082885B2 (en) | Information input and output apparatus and information input and output method | |
| CN215416588U (en) | Split type hand wearing equipment and man-machine interaction equipment for head-mounted display equipment | |
| CN207301977U (en) | A kind of virtual reality glove | |
| CN203982351U (en) | Gesture input device | |
| CN205548573U (en) | Tape code schedules's intelligent wearing equipment of motion of riding | |
| CN113063417A (en) | Control method based on foot posture interaction | |
| CN212818006U (en) | Body-building ring with motion mode detection | |
| CN210321758U (en) | Human body posture recognition instrument device | |
| CN209803741U (en) | handwriting recording and transmitting pen | |
| CN214016163U (en) | Auxiliary glove for deaf-mute | |
| CN217426070U (en) | Sign language gesture recognition and collection device | |
| CN220694561U (en) | Intelligent wearing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |