CN111001154A - Intelligent finger-guessing entertainment system with voice broadcasting function - Google Patents
Intelligent finger-guessing entertainment system with voice broadcasting function Download PDFInfo
- Publication number
- CN111001154A CN111001154A CN202010026712.6A CN202010026712A CN111001154A CN 111001154 A CN111001154 A CN 111001154A CN 202010026712 A CN202010026712 A CN 202010026712A CN 111001154 A CN111001154 A CN 111001154A
- Authority
- CN
- China
- Prior art keywords
- guessing
- voice
- serial port
- controller
- voice recognition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000006870 function Effects 0.000 claims abstract description 23
- 230000000007 visual effect Effects 0.000 claims abstract description 12
- 239000004744 fabric Substances 0.000 claims description 12
- 239000004575 stone Substances 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 11
- 230000008569 process Effects 0.000 claims description 5
- 238000010586 diagram Methods 0.000 description 3
- 238000003708 edge detection Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000009466 transformation Effects 0.000 description 2
- 230000003213 activating effect Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 210000001145 finger joint Anatomy 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000005215 recombination Methods 0.000 description 1
- 230000006798 recombination Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F9/00—Games not otherwise provided for
- A63F9/24—Electric games; Games using electronic circuits not otherwise provided for
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/107—Static hand or arm
- G06V40/113—Recognition of static hand signs
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F9/00—Games not otherwise provided for
- A63F9/24—Electric games; Games using electronic circuits not otherwise provided for
- A63F2009/2401—Detail of input, input devices
- A63F2009/243—Detail of input, input devices with other kinds of input
- A63F2009/2432—Detail of input, input devices with other kinds of input actuated by a sound, e.g. using a microphone
- A63F2009/2433—Voice-actuated
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F9/00—Games not otherwise provided for
- A63F9/24—Electric games; Games using electronic circuits not otherwise provided for
- A63F2009/2401—Detail of input, input devices
- A63F2009/243—Detail of input, input devices with other kinds of input
- A63F2009/2435—Detail of input, input devices with other kinds of input using a video camera
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses an intelligent finger-guessing entertainment system with a voice broadcasting function, which belongs to the technical field of entertainment systems and comprises a visual system, a controller and a voice recognition module, wherein the visual system comprises: the voice recognition device comprises a camera, a control circuit, an interface circuit and an embedded processor, wherein a controller module comprises the embedded processor and the interface circuit, and a voice recognition module comprises a sound pickup, a language processing module and the interface circuit; the vision system is connected with the controller by an RS232 serial port, information is exchanged by RS232 serial port communication, and optionally, communication can be carried out by a GPIO or RS485 serial port; the voice recognition and the controller are connected by adopting a UART serial port, exchange information through UART serial port communication, and optionally communicate through a GPIO or RS485 serial port; the judgment result is reported through voice, and the judgment of the punch-out gesture is carried out through a template matching algorithm, so that the system complexity can be greatly reduced.
Description
Technical Field
The invention belongs to the technical field of entertainment systems, color comparison and basic camera technologies, and particularly relates to an intelligent finger-guessing entertainment system with a voice broadcasting function.
Background
Guessing a fist, a simple game, and having three gestures of scissors, stones and cloth. Two persons can simultaneously take corresponding shapes by hands, and the win-win judgment rules are that the scissors win cloth, cloth wins stones and stones win the scissors.
In the prior art CN105034006A, a mechanical device is needed to realize a finger guessing function, the cost is higher, the system is complex, and the problems can be effectively avoided by using language input and output.
In the above-mentioned publication, a fist making gesture is determined based on three-dimensional position coordinate information of each finger joint bone space of a boxer, and a fist guessing process is achieved, in order to achieve the first making gesture, image acquisition equipment is required to have higher resolution, otherwise, the three-dimensional position coordinate information is inaccurate, and a determination result is affected. The method identifies the gestures based on template matching, firstly collects three boxing gesture images of a boxer, and then matches the templates in the subsequent judgment process, and the resolution of the image acquisition equipment is not high as the templates are from the boxer.
Disclosure of Invention
The invention aims to provide an intelligent finger-guessing entertainment system with a voice broadcasting function, which can utilize a voice broadcasting judgment result and a template matching algorithm to judge a finger-making gesture, and can greatly reduce the complexity of the system so as to solve the problems in the background technology.
In order to achieve the purpose, the invention provides the following technical scheme: an intelligent finger-guessing entertainment system with a voice broadcasting function comprises a visual system, a controller module and a voice recognition module;
the vision system comprises a camera, a control circuit, an interface circuit and an embedded processor;
the controller module comprises an embedded processor and an interface circuit;
the voice recognition module comprises a sound pickup, a language processing module and an interface circuit;
the vision system is connected with the controller module through an RS232 serial port, the voice recognition module is connected with the controller module through a UART serial port, and the vision system can judge the current gesture.
Preferably, the voice recognition unit is connected with the controller through a UART serial port, and the vision system can judge the current gesture.
Preferably, the UART serial port may be replaced by a GPIO or RS485 serial port.
Preferably, the image color blocks extracted in step S8 are automatically focused by opening the camera to capture an image G, which includes the projected color blocks.
Preferably, the voice broadcast is realized through the following processes:
s1, a voice recognition module awakens words, and the whole system is in a preparation starting working stage;
s2, the voice recognition module waits for a start command;
s3, the voice recognition module box controller sends out a handshake signal;
s4, the controller acquires the current vision system identification result;
s5, the controller generates the results of 'stone', 'scissors' and 'cloth';
s6, the controller judges whether the randomly generated result and the recognition result are successful or negative;
s7, the controller sends the result of the win or loss judgment, the result of the visual system identification and the result generated immediately to the voice identification module;
and S8, the voice recognition module broadcasts the result.
Preferably, the visual system determining the gesture comprises the following steps: a. acquiring a picture; b. processing an image; c. collecting data; d. and (6) analyzing the data.
Preferably, the step a includes background removal, where the background removal is implemented by using a frame difference method
Preferably, the step b acquires data from the contour by color block.
Preferably, in the step c, the ROI image of the gesture is obtained by a monochrome gray-scale patch tracking method.
Preferably, in the step d, the current gesture information is recognized through analyzing two features of the area of the gesture ROI image and the aspect ratio of the bounding box.
The invention has the beneficial effects that: the method realizes the recognition of three gestures, namely stone, scissors and cloth, based on a single camera, has a simpler and more efficient recognition algorithm, and can greatly reduce the complexity of the system by using a voice broadcast judgment result and a template matching algorithm to judge the boxing gesture.
Drawings
FIG. 1 is a block diagram of an intelligent finger-guessing entertainment system with voice broadcasting function according to the present invention;
FIG. 2 is a schematic flow chart of the steps of an intelligent finger-guessing entertainment system with a voice broadcasting function according to the present invention;
FIG. 3 is a flowchart of an algorithm for determining a current gesture by a vision system of the intelligent finger-guessing entertainment system with a voice broadcasting function according to the present invention;
FIG. 4 is a schematic diagram of image transformation of an intelligent finger-guessing entertainment system with voice broadcasting function according to the present invention;
fig. 5 is a schematic data acquisition diagram of the intelligent finger-guessing entertainment system with the voice broadcasting function provided by the invention.
Detailed Description
In order to further understand the contents, features and effects of the present invention, the following embodiments are illustrated and described in detail with reference to the accompanying drawings.
Referring to fig. 1 to 5, an intelligent finger-guessing entertainment system with a voice broadcasting function according to an embodiment of the present invention will be described in detail below with reference to the accompanying drawings.
In fig. 1, the intelligent finger-guessing entertainment system with voice broadcasting function comprises a vision system, a controller module and a voice recognition module;
the vision system comprises a camera, a control circuit, an interface circuit and an embedded processor;
the controller module comprises an embedded processor and an interface circuit;
the voice recognition module comprises a sound pickup, a language processing module and an interface circuit;
the vision system is connected with the controller module through an RS232 serial port, the voice recognition module is connected with the controller module through a UART serial port, and the vision system can judge the current gesture.
Further, the RS232 serial port can be replaced by a GPIO or RS485 serial port.
Further, the UART serial port can be replaced by a GPIO or RS485 serial port.
As shown in fig. 2, the voice broadcast in the intelligent finger guessing entertainment system with the voice broadcast function is realized through the following processes:
s1, a voice recognition module awakens words, and the whole system is in a preparation starting working stage;
s2, the voice recognition module waits for a start command;
s3, the voice recognition module box controller sends out a handshake signal;
s4, the controller acquires the current vision system identification result;
s5, the controller generates the results of 'stone', 'scissors' and 'cloth';
s6, the controller judges whether the randomly generated result and the recognition result are successful or negative;
s7, the controller sends the result of the win or loss judgment, the result of the visual system identification and the result generated immediately to the voice identification module;
and S8, the voice recognition module broadcasts the result.
As shown in fig. 3, the vision system determining the gesture includes the following steps: a. acquiring a picture; b. processing an image; c. collecting data; d. and (6) analyzing the data.
Further, the step a comprises background removal, wherein the background removal is realized by adopting a frame difference mode; the background removal is realized by adopting a frame difference mode, firstly, a frame of picture without a gesture is shot and stored, then, the shot frame of picture with the gesture is subtracted from the picture, and the background removal picture can be obtained. Alternatively, background removal may also be achieved in other ways in a similar manner.
Further, step b obtains data from the outline through the color blocks; the image transformation is mainly realized in an edge detection mode, and the image is further processed by an edge detection method.
Further, in the step c, an ROI image of the gesture is obtained in a monochrome gray color block tracking mode;
further, in the step d, current gesture information is recognized through two characteristics of the area of the gesture ROI image and the length-width ratio of the boundary box; analyzing two characteristics of the area of the gesture ROI image and the length-width ratio of a bounding box, identifying current gesture information through the two characteristics, as shown in the following table, judging thresholds of three gesture characteristics of stone, scissors and cloth, wherein when judging is carried out, gestures meeting the threshold value of 0.9-1.1 can be identified as specific gestures, and when not meeting the threshold value, the gestures are judged to be invalid gestures
| height/width | area | pixels | |
| Stone (W.E.) | 1.172 | 4373.916 | 467.088 |
| Cloth | 0.776 | 4967.906 | 232.304 |
| Scissors | 0.590 | 5535.613 | 529.949 |
The working principle of the invention is as follows: activating a voice recognition module by providing a wake-up word, sending a handshake signal to a controller module by the voice recognition module when the voice recognition module recognizes that the wake-up word is 'start', and simultaneously acquiring a recognition result of a current visual system by the controller module;
in the visual system, the method for identifying the result comprises the steps of obtaining a picture, removing the background of the obtained picture to obtain an image after image processing, detecting the edge of a gesture by color block tracking, collecting data, analyzing the area of a gesture ROI image and the length-width ratio of a boundary frame by data recombination, contrasting the judgment thresholds of three gesture characteristics of stone, scissors and cloth, carrying out data analysis, comparing 2 gesture data of a user with a summarized result if the gesture is a specific gesture to obtain three gestures of stone, scissors and cloth, printing the image to detect the edge of the gesture by color block tracking again if the gesture is not the specific gesture, and collecting the data;
the controller generates a stone result, a scissors result and a cloth result immediately after the controller acquires the current visual system identification result, the controller judges whether the generated result and the identification result are successful or not immediately, after the success or failure judgment result is obtained, the success or failure judgment result, the visual system identification result and the immediately generated result are sent to the voice identification module through the controller, and the result is broadcasted through the voice identification module.
Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that changes, modifications, substitutions and alterations can be made in these embodiments without departing from the principles and spirit of the invention, the scope of which is defined in the appended claims and their equivalents.
Claims (9)
1. An intelligent finger-guessing entertainment system with a voice broadcasting function is characterized by comprising a visual system, a controller module and a voice recognition module;
the vision system comprises a camera, a control circuit, an interface circuit and an embedded processor;
the controller module comprises an embedded processor and an interface circuit;
the voice recognition module comprises a sound pickup, a language processing module and an interface circuit;
the vision system is connected with the controller module through an RS232 serial port, the voice recognition module is connected with the controller module through a UART serial port, and the vision system can judge the current gesture.
2. The intelligent finger-guessing and boxing entertainment system with the voice broadcasting function is characterized in that the RS232 serial port can be replaced by a GPIO or RS485 serial port.
3. The intelligent finger-guessing and boxing entertainment system with the voice broadcasting function is characterized in that the UART serial port can be replaced by a GPIO or RS485 serial port.
4. The intelligent finger-guessing entertainment system with the voice broadcasting function according to claim 1, characterized in that the voice broadcasting is realized by the following processes:
s1, a voice recognition module awakens words, and the whole system is in a preparation starting working stage;
s2, the voice recognition module waits for a start command;
s3, the voice recognition module box controller sends out a handshake signal;
s4, the controller acquires the current vision system identification result;
s5, the controller generates the results of 'stone', 'scissors' and 'cloth';
s6, the controller judges whether the randomly generated result and the recognition result are successful or negative;
s7, the controller sends the result of the win or loss judgment, the result of the visual system identification and the result generated immediately to the voice identification module;
and S8, the voice recognition module broadcasts the result.
5. The intelligent finger-guessing entertainment system with voice broadcasting function as claimed in claim 1 or 4, wherein the said vision system determining the gesture comprises the following steps: a. acquiring a picture; b. processing an image; c. collecting data; d. and (6) analyzing the data.
6. The intelligent finger-guessing and boxing entertainment system with the voice broadcasting function as claimed in claim 5, wherein the step a comprises background removal, wherein the background removal is realized by frame difference.
7. The intelligent finger-guessing game system with voice broadcasting function as claimed in claim 5, wherein the step b is to obtain data from the outline by color block.
8. The intelligent finger-guessing entertainment system with the voice broadcasting function is characterized in that the ROI image of the gesture is obtained in the step c through a monochrome gray color block tracking mode.
9. The intelligent finger-guessing entertainment system with voice broadcasting function as claimed in claim 5, wherein in the step d, the current gesture information is identified by analyzing two features of the area of the ROI image of the gesture and the length-width ratio of the bounding box.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010026712.6A CN111001154A (en) | 2020-01-10 | 2020-01-10 | Intelligent finger-guessing entertainment system with voice broadcasting function |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010026712.6A CN111001154A (en) | 2020-01-10 | 2020-01-10 | Intelligent finger-guessing entertainment system with voice broadcasting function |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111001154A true CN111001154A (en) | 2020-04-14 |
Family
ID=70121035
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010026712.6A Pending CN111001154A (en) | 2020-01-10 | 2020-01-10 | Intelligent finger-guessing entertainment system with voice broadcasting function |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111001154A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0773289A (en) * | 1993-09-01 | 1995-03-17 | Gijutsu Kenkyu Kumiai Shinjiyouhou Shiyori Kaihatsu Kiko | Recognition method for gesture animation image |
| JPH08299601A (en) * | 1995-05-10 | 1996-11-19 | Ricoh Elemex Corp | Robot system |
| CN101853071A (en) * | 2010-05-13 | 2010-10-06 | 重庆大学 | Gesture identification method and system based on visual sense |
| CN103034323A (en) * | 2011-09-30 | 2013-04-10 | 德信互动科技（北京）有限公司 | Man-machine interaction system and man-machine interaction method |
| CN103679145A (en) * | 2013-12-06 | 2014-03-26 | 河海大学 | Automatic gesture recognition method |
| CN105034006A (en) * | 2015-08-28 | 2015-11-11 | 昆山塔米机器人有限公司 | Finger-guessing game robot based on LeapMotion apparatus and finger-guessing game gesture recognition method |
| CN109165555A (en) * | 2018-07-24 | 2019-01-08 | 广东数相智能科技有限公司 | Man-machine finger-guessing game method, apparatus and storage medium based on image recognition |
-
2020
- 2020-01-10 CN CN202010026712.6A patent/CN111001154A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0773289A (en) * | 1993-09-01 | 1995-03-17 | Gijutsu Kenkyu Kumiai Shinjiyouhou Shiyori Kaihatsu Kiko | Recognition method for gesture animation image |
| JPH08299601A (en) * | 1995-05-10 | 1996-11-19 | Ricoh Elemex Corp | Robot system |
| CN101853071A (en) * | 2010-05-13 | 2010-10-06 | 重庆大学 | Gesture identification method and system based on visual sense |
| CN103034323A (en) * | 2011-09-30 | 2013-04-10 | 德信互动科技（北京）有限公司 | Man-machine interaction system and man-machine interaction method |
| CN103679145A (en) * | 2013-12-06 | 2014-03-26 | 河海大学 | Automatic gesture recognition method |
| CN105034006A (en) * | 2015-08-28 | 2015-11-11 | 昆山塔米机器人有限公司 | Finger-guessing game robot based on LeapMotion apparatus and finger-guessing game gesture recognition method |
| CN109165555A (en) * | 2018-07-24 | 2019-01-08 | 广东数相智能科技有限公司 | Man-machine finger-guessing game method, apparatus and storage medium based on image recognition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9460339B2 (en) | Combined color image and depth processing | |
| CN101271514B (en) | Image detection method and device for fast object detection and objective output | |
| CN110866903B (en) | Ping-pong ball identification method based on Hough circle transformation technology | |
| KR100826878B1 (en) | Hand shafe recognition method and apparatus for thereof | |
| JP4597391B2 (en) | Facial region detection apparatus and method, and computer-readable recording medium | |
| JP2001331799A (en) | Image processor and image processing method | |
| CN105975938A (en) | Smart community manager service system with dynamic face identification function | |
| JP2015075914A (en) | Eye part detecting device, method, and program | |
| JP2000105819A (en) | Face image area detecting device | |
| CN113191216B (en) | Multi-user real-time action recognition method and system based on posture recognition and C3D network | |
| CN107648833A (en) | A kind of contactless man-machine chess's control method and system based on machine vision | |
| CN111967319A (en) | Infrared and visible light based in-vivo detection method, device, equipment and storage medium | |
| CN110765924A (en) | Living body detection method and device and computer-readable storage medium | |
| JP2002282210A (en) | Method and apparatus for detecting visual axis | |
| CN110936920A (en) | Vehicle trunk opening method and device, vehicle and storage medium | |
| CN113609953A (en) | Non-contact palm vein area identification method, system and storage medium | |
| CN110222647B (en) | Face in-vivo detection method based on convolutional neural network | |
| CN111325058A (en) | Driving behavior detection method, device and system and storage medium | |
| JPH10162118A (en) | Device and method for image processing | |
| CN110084177B (en) | Positioning system, method, control system, air conditioner and storage medium | |
| CN104573628A (en) | Three-dimensional face recognition method | |
| JP4390487B2 (en) | Head region extraction device | |
| CN111001154A (en) | Intelligent finger-guessing entertainment system with voice broadcasting function | |
| CN103955917A (en) | Long-gap air electric arc image edge detection method | |
| CN106156774A (en) | Image processing method and image processing system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220408 Address after: 450000 Room 608, 6 / F, building 8, Henan National University Science Park (East District), No. 289, West Third Ring Road, Zhengzhou high tech Industrial Development Zone, Zhengzhou, Henan Province Applicant after: Zhengzhou Mingke Education Technology Co.,Ltd. Address before: 100089 104-278, building 6, courtyard 1, gaolizhang Road, Haidian District, Beijing Applicant before: Beijing Mingke Education Technology Co.,Ltd. |
|
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200414 |