CN105491210A - Intelligent terminal system - Google Patents
Intelligent terminal system Download PDFInfo
- Publication number
- CN105491210A CN105491210A CN201410472163.XA CN201410472163A CN105491210A CN 105491210 A CN105491210 A CN 105491210A CN 201410472163 A CN201410472163 A CN 201410472163A CN 105491210 A CN105491210 A CN 105491210A
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- coordinate system
- module
- video flowing
- axis
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses an intelligent terminal system, and the system comprises a camera, an intelligent terminal, an optical recognition code list, and an optical recognition device. The camera comprises a camera module, a storage unit, a transmission interface, an initialization module, a processing module, and a recognition module. The intelligent terminal storages instruction information corresponding to a standard gesture, and completes the corresponding operation according to the instruction information corresponding to the gesture recognized by the camera. The intelligent terminal carries out corresponding operation according to an instruction corresponding to an optical recognition code read by the optical recognition device. The system enables the technology of optical recognition, the technology of gesture recognition and the intelligent terminal to be integrated together, can complete the control and specific operation at a longer distance, greatly simplifies the operation steps, further improves the user efficiency of the intelligent terminal, and is especially suitable for a conference.
Description
Technical field
The invention belongs to electronic device field, be specifically related to intelligent terminal system.
Background technology
Along with the development of society, increasing intelligent terminal intelligent terminal such as desktop computer, notebook computer and panel computer, smart mobile phone etc. are used on a large scale, enter in the life of people, work, also achieve significant progress in communications field wireless communication technology simultaneously.People's browsing page, consult document etc. and need to carry out many more manipulations and complete, such as, in conference process, need specifically to operate computer, can be completed by radio keyboard mouse, step is comparatively loaded down with trivial details.
The technology that light recognition device reads light identification code is a kind of prior art, is mainly used in language teaching, reads the light identification code on light identification code list, and then sound, to reach the object learned a language by light recognition device.
Gesture manipulation function makes intelligent terminal system be endowed increasing application scenarios, and such as somatic sensation television game is the game that the another kind of degree of participation that both grows up after plug-in card game machine is higher.In somatic sensation television game now, many usage datas line connects or that wireless sensing mode realizes with intelligent terminal picture is mutual, reaches the object of amusement.Camera can capture the image in image pickup scope, and utilizing camera to catch gesture is a kind of new data entry mode, and camera captures gesture to be changed and is translated in control signal input intelligent terminal system.Which can not only be applied in somatic sensation television game, for remote-controlled intelligent terminal provides a kind of new mode, more can be applied to the occasion with intelligent terminal system interaction, have powerful Potential socialvalue.
Summary of the invention
In order to solve prior art Problems existing, the invention provides a kind of intelligent terminal system, completing control and specific operation more at a distance, can improve the application potential of intelligent terminal further, to achieve these goals, the present invention is by the following technical solutions:
A kind of intelligent terminal system, comprises intelligent terminal and camera; Described camera is connected with described intelligent terminal by its coffret, also comprises:
Light identification code list, described smooth identification code list is provided with multiple pattern, and each pattern position is provided with corresponding light identification code;
Light recognition device, for reading described smooth identification code and being sent by information wireless corresponding for described smooth identification code;
Described intelligent terminal is provided with the radio receiving transmitting module of light identification code corresponding informance described in wireless receiving, and the output of described radio receiving transmitting module is electrically connected with the input of described coffret.
Further, described radio receiving transmitting module is bluetooth module.
Further, described camera comprises:
Photographing module, described photographing module is provided with camera lens and imageing sensor;
Memory, for pre-stored standard gesture;
Initialization module, for set up with described image sensor surface be the first coordinate plane the first coordinate system, with the second coordinate system to palmar aspect during described camera lens being just the second coordinate plane, determine the position of described second coordinate system in described first coordinate system;
Processing module, for the treatment of the hands movement image that described photographing module gathers, obtains the position video flowing of described second coordinate system in described first coordinate system and the video flowing of hand in described second coordinate system, forms gesture input;
Identification module, makes comparisons for the gesture that described processing module exported and described standard gesture, if mate with standard gesture described in, then using this standard gesture as recognition result, and be sent to described coffret;
Described intelligent terminal is provided with memory module, stores and described standard gesture command information one to one in described memory module.
Further, described first coordinate system for reference axis, is first initial point with the center of described imageing sensor with the vertical line of the vertical direction line in described first coordinate plane, horizontal direction line and described vertical direction line, horizontal direction line; In described second coordinate plane, get that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Described second coordinate system with described X-axis, Y-axis and perpendicular to the Z axis of described X-axis, Y-axis for reference axis; Be the second initial point with the intersection point of described X-axis, Y-axis.
Further, described second coordinate is three-dimensional system of coordinate, and described position video flowing is the position video flowing of the second initial point in described second coordinate system; The video flowing of hand in described second coordinate system, comprising: the video flowing that the bending and rotation of palm of finger is formed; Described position video flowing is the position video flowing of the second initial point in described second coordinate system and the video flowing of described second coordinate system rotation; The video flowing of hand in described second coordinate system, comprising: the video flowing be bent to form of finger.
Further, described coffret is USB interface.
Further, described smooth recognition device comprises the reading unit for reading described smooth identification code, and the transmitting element that information wireless corresponding to the described smooth identification code read by described reading unit sends; Described radio receiving transmitting module and described transmitting element wireless connections.
Further, described smooth recognition device also comprises the push-button unit being connected with described transmitting element, inputting for signal.
Further, also comprise cloud server terminal, described intelligent terminal is connected with cloud server terminal by network interface.
Further, described cloud server terminal comprises recognition unit and stores the database outputing signal corresponding data or instruction with described recognition unit.
Light recognition technology, Gesture Recognition and intelligent terminal combine by intelligent terminal system of the present invention, control and specific operation can be completed under comparatively remote, greatly simplifie operating procedure, what further increase intelligent terminal utilizes usefulness, is particularly suitable for the occasions such as meeting.
Accompanying drawing explanation
Fig. 1 is the module map of a kind of intelligent terminal system embodiment 1 of the present invention;
Fig. 2 is the schematic diagram of camera first coordinate system in the present invention;
Fig. 3 is the schematic diagram of camera second coordinate system in the present invention;
Fig. 4 is the module map of a kind of intelligent terminal system embodiment 2 of the present invention.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
With reference to the module map that Fig. 1, Fig. 1 are a kind of intelligent terminal system embodiment 1 of the present invention, this intelligent terminal system comprises camera 10 and intelligent terminal 20, light identification code list 40 and light recognition device 50, and camera 10 is connected with intelligent terminal 20.
Wherein, camera 10 comprises photographing module 1, initialization module 2, processing module 3, identification module 4, memory 5 and coffret 6.
Photographing module 1 is for gathering hands movement image, and this photographing module 1 is provided with camera lens 11 and imageing sensor 12.Camera lens 11 is glass lens, plastic lens or plastics and glass hybrid lens.Imageing sensor 12 is a kind of light receiving semiconductor chips, its surface includes hundreds of thousands to millions of photodiodes, photodiode is subject to will producing electric charge when illumination is penetrated, when the image projection that photographing module 1 receives is on imageing sensor 12, on imageing sensor 12, the distribution of electric charge characterizes the image taken in.
In order to the hands movement image that photographing module 1 gathers can be identified accurately, the present invention's adopt initialization module 2 to set up the first coordinate system that image taking sensor 12 surface is the first coordinate plane, with the second coordinate system to palmar aspect during camera lens being just the second coordinate plane, and determine the position of described second coordinate system in described first coordinate system.Because the position of hand in the second mark system can be determined, and then the position of hand in the first coordinate system can be determined.
In preferably embodiment, first coordinate system as shown in Figure 2, image taking sensor 12 surface is the first coordinate plane, the vertical line L of vertical direction line V, horizontal direction line H in this first coordinate plane and vertical direction line V, horizontal direction line H is reference axis, and the center of image taking sensor 12 is the first initial point.At the second coordinate system as shown in Figure 3, palmar aspect is in the second coordinate plane, gets that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Second coordinate system with X-axis, Y-axis and perpendicular to the Z axis of X-axis, Y-axis for reference axis; Be the second initial point with the intersection point of X-axis, Y-axis.
Processing module 3 processes the hands movement image that photographing module 1 gathers, and obtains the position video flowing of the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, forms gesture input.
Particularly, photographing module 1 gathers hand image with certain speed, the speed acquisition of such as 30 frames/s, first frame hand image is transferred to processing module 3 after the process of initialization module 2, processing module 3 obtains position in the first coordinate system of the first coordinate system, the second coordinate system and the second coordinate system and the position of hand in the second coordinate system, and in this, as initial condition.Second frame hand image is transferred to processing module 3 after initialization module 2 processes, the position of the second initial point that processing module 3 obtains the second coordinate system in the first coordinate system and the position of hand in the second coordinate system, successively to the 3rd frame, the 4th frame ... hand image procossing, the position video flowing of the second initial point obtaining the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, form gesture input.In this embodiment, position video flowing is the position video flowing of the second initial point in the first coordinate system in the second coordinate system; The video flowing of hand in the second coordinate system comprises the bending video flowing formed with the rotation of palm of finger.
The acquisition of processing module 3 to input gesture also has the second embodiment, in this scenario, first frame hand image is transferred to processing module 3 after the process of initialization module 2, and processing module 3 obtains position in the first coordinate system of the first coordinate system, the second coordinate system and the second coordinate system and the position of hand in the second coordinate system.Second frame hand image is transferred to processing module 3 after initialization module 2 processes, processing module 3 obtains position in the first coordinate system of the second coordinate system, the second coordinate system and the position of hand in the second coordinate system, successively to the 3rd frame, the 4th frame ... hand image procossing, obtain the position video flowing of the second coordinate system in the first coordinate system and the video flowing of hand in the second coordinate system, form gesture input.In this embodiment, position video flowing is the position video flowing of the second initial point in the first coordinate system and the video flowing of the second coordinate system rotation in the second coordinate system; The video flowing of hand in the second coordinate system comprises the bending video flowing of finger.
In above two kinds of embodiments, the first coordinate system that initialization module 2 is set up is constant, and the second coordinate system of foundation may cause change along with hands movement.In the first embodiment, processing module 3 does not consider the change of the second coordinate system when processing hand image, and the change of the change of the second coordinate system by hand position in the second coordinate system is represented.In the second embodiment, initialization module 2 all re-establishes the second coordinate system in each frame hand image, processing module 3 obtains the position of the second coordinate system in the first coordinate system in each frame hand image, the position of hand in the second coordinate system in each frame hand image.
Identification module 4 receiving processing module 3 export gesture, the standard gesture of pre-stored in this gesture and memory 5 is made comparisons, if mate with a standard gesture, then using this standard gesture as recognition result, be sent to coffret 6.
Processing module 3 starts when detecting image in one's hands to identify gesture, and when continuous several times receives identical hand image, the hand image such as received within 0.5-3 second is all identical, identifies that gesture terminates.
Intelligent terminal 20 is provided with memory module 201 and bluetooth module (radio receiving transmitting module) 202, stores and standard gesture command information one to one in memory module 201.Recognition result is exported to intelligent terminal 20 by coffret 6 by the identification module 4 of camera 10, and intelligent terminal 20 transfers corresponding command information according to this recognition result, completes corresponding operation.
Light identification code list 40 is provided with multiple pattern, and each pattern position is provided with corresponding light identification code; Information corresponding for this light identification code for reading light identification code, and wirelessly sends by light recognition device 50; The bluetooth module 202 of intelligent terminal 20 is wirelessly connected with light recognition device 50, can receive the wireless signal that light recognition device 50 sends, display or execution command adapted thereto on intelligent terminal 20.
In concrete enforcement, the pattern on light identification code list 40 can represent the content of light identification code intuitively, clicks image by light recognition device 50, namely can read the light identification code that this image is corresponding, obtains the content that this image represents.Light recognition device 50 can identify optical identification code, and light recognition device 50 reads optical identification code, produces corresponding wireless signal and sends.
With reference to Fig. 4, Fig. 4 is the module map of a kind of intelligent terminal system embodiment 2 of the present invention, this intelligent terminal system comprises the camera 10, intelligent terminal 20, cloud server terminal 30, light identification code list 40 and the light recognition device 50 that connect successively, and cloud server terminal 30 is provided services on the Internet for intelligent terminal 20.
Wherein, camera 10 comprises photographing module 1, initialization module 2, processing module 3, identification module 4, memory 5 and USB interface 6, and photographing module 1 is provided with camera lens 11 and imageing sensor 12.
Differently compared with embodiment 1 be, the coffret of the present embodiment 2 camera 10 adopts USB interface, has more versatility; Increase the cloud server terminal 30 be connected with intelligent terminal 20; Light identification code list 40 and light recognition device 50 also have difference.
Light identification code list 40 can be papery or plastic material etc., which is provided with multiple pattern, and each pattern position is provided with corresponding light identification code 401.
Light recognition device 50 comprises reading unit 501, transmitting element 502, power subsystem and push-button unit (not shown), reading unit 501 is for reading light identification code 401, obtain the information of its correspondence, transmitting element 502 obtains the wireless transmission of information for reading unit 401, and the information by reading unit 401 acquisition is converted to wireless signal and sends.Power subsystem provides electric energy for the work of light recognition device 50, power subsystem can be dry cell, lithium battery and other storage battery, can charge-discharge battery.Push-button unit is connected with transmitting element 502, for signal input and go out through transmitting element 502 wireless transmission; Push-button unit can comprise upper and lower, left and right key and middle key.In other embodiments, light recognition device 50 can also arrange LED light or display unit, whether in running order with pilot light recognition device 50.
Cloud server terminal 30 comprises recognition unit 301 and database 302, recognition unit 301 receives the signal message that intelligent terminal 20 exports, database 302 stores and outputs signal corresponding data or instruction with reading unit 501, also the signal message corresponding data or instruction that receive with recognition unit 301 is, the signal message that cloud server terminal 30 receives according to recognition unit 301 transfers corresponding data or instruction from database 302, and these data or instruction are exported to intelligent terminal 20.
In other embodiments, also store the data corresponding with the command information that gesture identification obtains or instruction in the database 302 of cloud server terminal 30, the command information that also can be obtained by gesture identification is conducted interviews to cloud server terminal 30.
Intelligent terminal 20 includes but not limited to desktop computer, notebook computer, panel computer and smart mobile phone etc., the equipment that such as desktop computer case and projection arrangement are formed by connecting.
When implementing, camera is connected with intelligent terminal by USB interface.In other embodiments, such as, when being applied to the intelligent terminal such as notebook computer, panel computer, intelligent terminal carries camera, now camera is integrated on intelligent terminal, and this kind of mode also should within the protection range of the claims in the present invention.
When implementing, light identification code monoenergetic enough designs as required accordingly, with the demand of satisfied different occasion, for working conference occasion, can handled easily, and improve meeting efficiency greatly.
The foregoing is only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.
Claims (10)
1. an intelligent terminal system, comprises intelligent terminal and camera; Described camera is connected with described intelligent terminal by its coffret, it is characterized in that, also comprises:
Light identification code list, described smooth identification code list is provided with multiple pattern, and each pattern position is provided with corresponding light identification code;
Light recognition device, for reading described smooth identification code and being sent by information wireless corresponding for described smooth identification code;
Described intelligent terminal is provided with the radio receiving transmitting module of light identification code corresponding informance described in wireless receiving, and the output of described radio receiving transmitting module is electrically connected with the input of described coffret.
2. intelligent terminal system according to claim 1, is characterized in that, described radio receiving transmitting module is bluetooth module.
3. intelligent terminal system according to claim 1, is characterized in that, described camera comprises:
Photographing module, described photographing module is provided with camera lens and imageing sensor;
Memory, for pre-stored standard gesture;
Initialization module, for set up with described image sensor surface be the first coordinate plane the first coordinate system, with the second coordinate system to palmar aspect during described camera lens being just the second coordinate plane, determine the position of described second coordinate system in described first coordinate system;
Processing module, for the treatment of the hands movement image that described photographing module gathers, obtains the position video flowing of described second coordinate system in described first coordinate system and the video flowing of hand in described second coordinate system, forms gesture input;
Identification module, makes comparisons for the gesture that described processing module exported and described standard gesture, if mate with standard gesture described in, then using this standard gesture as recognition result, and be sent to described coffret;
Described intelligent terminal is provided with memory module, stores and described standard gesture command information one to one in described memory module.
4. intelligent terminal system according to claim 3, it is characterized in that, described first coordinate system for reference axis, is first initial point with the center of described imageing sensor with the vertical line of the vertical direction line in described first coordinate plane, horizontal direction line and described vertical direction line, horizontal direction line; In described second coordinate plane, get that wrist place rectilinear direction is X-axis, palm lateral border place is Y-axis perpendicular to the straight line of X-axis; Described second coordinate system with described X-axis, Y-axis and perpendicular to the Z axis of described X-axis, Y-axis for reference axis; Be the second initial point with the intersection point of described X-axis, Y-axis.
5. intelligent terminal system according to claim 3, is characterized in that, described second coordinate is three-dimensional system of coordinate, and described position video flowing is the position video flowing of the second initial point in described second coordinate system; The video flowing of hand in described second coordinate system, comprising: the video flowing that the bending and rotation of palm of finger is formed; Described position video flowing is the position video flowing of the second initial point in described second coordinate system and the video flowing of described second coordinate system rotation; The video flowing of hand in described second coordinate system, comprising: the video flowing be bent to form of finger.
6. intelligent terminal system according to claim 1, is characterized in that, described coffret is USB interface.
7. intelligent terminal system according to claim 1, is characterized in that, described smooth recognition device comprises the reading unit for reading described smooth identification code, and the transmitting element that information wireless corresponding to the described smooth identification code read by described reading unit sends; Described radio receiving transmitting module and described transmitting element wireless connections.
8. the intelligent terminal system according to claim 1 or 7, is characterized in that, described smooth recognition device also comprises the push-button unit being connected with described transmitting element, inputting for signal.
9. intelligent terminal system according to claim 1, is characterized in that, also comprises cloud server terminal, and described intelligent terminal is connected with described cloud server terminal by network interface.
10. intelligent terminal system according to claim 9, is characterized in that, described cloud server terminal comprises recognition unit and stores the database outputing signal corresponding data or instruction with described recognition unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410472163.XA CN105491210A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410472163.XA CN105491210A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105491210A true CN105491210A (en) | 2016-04-13 |
Family
ID=55677913
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410472163.XA Pending CN105491210A (en) | 2014-09-16 | 2014-09-16 | Intelligent terminal system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105491210A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862852A (en) * | 2017-10-09 | 2018-03-30 | 厦门盈趣科技股份有限公司 | The intelligent remote control device and control method of adaptation plurality of devices based on location matches |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102509063A (en) * | 2011-10-26 | 2012-06-20 | 中山外星文教科技股份有限公司福州分公司 | Synchronous reading system and synchronous reading method |
| CN103035134A (en) * | 2012-12-10 | 2013-04-10 | 张肃 | Image touch and talk playing system and mage touch and talk playing method |
-
2014
- 2014-09-16 CN CN201410472163.XA patent/CN105491210A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102509063A (en) * | 2011-10-26 | 2012-06-20 | 中山外星文教科技股份有限公司福州分公司 | Synchronous reading system and synchronous reading method |
| CN103035134A (en) * | 2012-12-10 | 2013-04-10 | 张肃 | Image touch and talk playing system and mage touch and talk playing method |
Non-Patent Citations (1)
| Title |
|---|
| 高国阳: "《《国防科技大学研究生院硕士学位论文》》", 1 November 2011 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107862852A (en) * | 2017-10-09 | 2018-03-30 | 厦门盈趣科技股份有限公司 | The intelligent remote control device and control method of adaptation plurality of devices based on location matches |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110495819B (en) | Robot control method, robot, terminal, server and control system | |
| CN102184014B (en) | Intelligent appliance interaction control method and device based on mobile equipment orientation | |
| CN111844046A (en) | Robot hardware system and robot thereof | |
| CN105487673A (en) | Man-machine interactive system, method and device | |
| CN103248874B (en) | Job site wireless portable data acquiring and transmission system headend equipment | |
| US10952267B2 (en) | Terminal and method for connecting to target devices | |
| CN202753155U (en) | Robot device used for Internet | |
| US11412555B2 (en) | Mobile terminal | |
| KR102102396B1 (en) | Mobile terminal | |
| KR102079033B1 (en) | Mobile terminal and method for controlling place recognition | |
| CN104169858A (en) | Method and device of using terminal device to identify user gestures | |
| CN105491210A (en) | Intelligent terminal system | |
| CN105491209A (en) | Intelligent terminal system | |
| CN105404387A (en) | Gesture remote control system for intelligent terminal | |
| CN105630252A (en) | Trajectory tracking camera | |
| CN105407371A (en) | Television system | |
| CN105487642A (en) | Interactive intelligent terminal system | |
| CN105487646A (en) | Intelligent terminal system with gesture remote function | |
| CN108897419A (en) | A kind of gesture command converting system and method | |
| CN105491411A (en) | Television system with function of signal conversion | |
| CN203327056U (en) | Identification system | |
| CN105487645A (en) | Intelligent terminal system having signal conversion function | |
| CN103473002A (en) | Intelligent terminal, input terminal and input method of intelligent terminal | |
| CN105487647A (en) | Intelligent terminal system with signal converting unction | |
| Kim et al. | Real-time Multi-device Control System Implementation for Natural User Interactive Platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160413 |