CN104516649A - Intelligent cell phone operating technology based on motion-sensing technology - Google Patents
Intelligent cell phone operating technology based on motion-sensing technology Download PDFInfo
- Publication number
- CN104516649A CN104516649A CN201310452146.5A CN201310452146A CN104516649A CN 104516649 A CN104516649 A CN 104516649A CN 201310452146 A CN201310452146 A CN 201310452146A CN 104516649 A CN104516649 A CN 104516649A
- Authority
- CN
- China
- Prior art keywords
- interface
- gesture
- cell phone
- mobile phone
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Provided is an intelligent cell phone operating technology based on motion-sensing technology; the intelligent cell phone operating technology based on motion-sensing technology comprises the following steps: installing a motion-sensing device inside a cell phone, and defining an interface inside an induction space of the motion-sensing device; previously setting a gesture module; visualizing a virtual interface by the projection of the front camera of the cell phone; analyzing gesture types and motion traces by utilizing the preset gesture templates, so as to obtain corresponding operation commands; converting the commands into messages and sending the messages to the CPU of the cell phone; controlling the camera by the CPU of the cell phone to update the information displayed on the virtual visualized interface. The intelligent cell phone operating technology based on motion-sensing technology does not depend on the conventional fixed input devices such as keyboard, voice and touchpad; and any hand-held induction tool is not required; the cell phone operation can be finished only in the induction space of the motion-sensing device; therefore, the cell phone operation interface is freed from the limitation of the real display screen; the user can adjust the size and definition of the virtual visualized interface based on the interest of the user, thereby achieving stereoscopic operations of cell phone, thus meeting different use requirements. The operation is free; the use is simple, convenient and comfortable.
Description
Technical field
The present invention relates to a kind of technology of operative intelligence mobile phone, specifically relates to a kind of operative technique of the smart mobile phone based on body sense technology.
Background technology
Along with development and the maturation of body sense technology, body sense technology is applied to computer input field and is achieved, for the mankind provide more comfortable and natural computer input mode.The Leap 3D of Kinect and the Leap Motion company of Microsoft is exactly two main brands in current body sense input field, under the prerequisite of operator without the need to hand-held any induction stage property, is caught by camera and sensor, the action of identifying operation person.Body sense technology obtains in computer realm well to be optimized and development.Body sense technology obtains certain achievement in research in field of play, by capturing outer signals, being resolved to control signal, sending messaging device to by wireless device, can realize the control of application programs.Nowadays most of mobile phone has gravity sensing function, for body sense mobile phone technique has established certain basis.Sony a new generation's body sense equipment PlayStation Move dynamic controller and PlayStation3 USB camera combination create entire new game pattern.PS MOVE not only can identification action up and down, also can respond to the angle change of wrist.So be no matter Fast Activities as motion or also can reappear one by one at PS MOVE with very thin action as pen drawing.Dynamic controller also can the degree of depth of inductive spacing, making player all of a sudden as stayed in gaming, experiencing game experiencing easily true to nature.
Body sense technology can be applied to text event detection field, the input equipment of this technology without the need to relying on conventional keyboard, microphone and board etc. fixing, also without the need to hand-held any sensing stage property, as long as just can handwriting input be completed in the inductive spacing of body sense equipment.Also can be applicable to surf the web and social dialogue, the even text event detection of office realm, can improve the comfort level of operator's operation, the experience of optimizing user while improving text input speed.
This method of operating can utilize existing body sense equipment to calculate the change in location of the hand of user and gesture change, resolve the change in location of the hand of user and gesture change, operate and upgrade graphical interfaces, thus control, operate computing machine used in everyday (such as PC and notebook computer), further expand the range of application of existing body sense equipment, be widely used in the equipment of the information processing capabilities such as PC, notebook computer, net book.
Mobile phone display desktop of today is limited to screen size to a great extent, although businessman constantly releases the mobile phone of various sizes size, user can only enjoy a kind of mobile phone of screen size.Consider that body sense technology is applied to the modernization and facilitation brought in many-sided field, so body sense technology is applied to mobile phone by this invention, the communication of mobile phone, amusement function are increased upper body sense technology, mobile phone interface is departed from mobile phone screen, with body sense technical operation mobile phone interface, practical function, the modern science and technology allowing user can experience mobile phone whenever and wherever possible truly to bring.
Summary of the invention
The object of the invention is to overcome deficiency of the prior art, provide a kind of input equipment without the need to relying on mobile phone conventional keyboard, voice and Trackpad etc. fixing, also without the need to hand-held any sensing stage property, as long as just can mobile phone operation be completed in the inductive spacing of body sense equipment; The restriction of mobile phone operation interface is broken away from true display screen, user can adjust size and the resolution of virtual visual interface according to the hobby of oneself, realize mobile phone perspective operational, meet different user demands, operation is free, the comfortable mobile phone operation method based on body sense technology easy to use.
In order to solve the problems of the technologies described above, the present invention is achieved through the following technical solutions:
The principle of work that the present invention is based on the operation system of smart phone of body sense technology is as follows:
1, below Touch Screen, an individual sense equipment can be set at mobile phone, and define an interface in the inductive spacing of body sense equipment.
2, preset gesture module, basic operation type has:
(1) raise one's hand: interface is activated;
(2) hand down: remove controls;
(3) gesture is the palm: to movement and the rotation of virtual scene;
(4) gesture is for thrusting out one's fingers: operational order selects object;
(5) gesture is when clenching fist, operational order be capture selected by object.
3, by the front-facing camera of mobile phone, camera is connected with mobile phone genuine interface, by shadow casting technique, mobile phone interface is projected to the interface in the inductive spacing of body sense equipment, make virtual interface visual.
4, identify the operating gesture of user and the movement locus in virtual visual interface thereof, the gesture of identifying operation person can by the coordinate realization of the institute in this gesture of measuring and calculating a little in virtual visual interface, and coordinate measurement and calculation, can realize based on stereovision technique.
5, utilize the gesture template preset, gesture classification and movement locus are resolved, the action type that the gesture of analysis operation person is corresponding, obtain corresponding operational order.Concrete operations type is resolved, according to the starting point of movement locus, intermediate point and end point, and the threshold value preset, determine that described movement locus is camber line or rectilinear motion.
6, corresponding operational order is changed into information by body sense equipment, conveys to mobile phone CPU and makes mobile phone interface fill order.
7, camera is by the adjustment of mobile phone interface reaction on virtual visual interface, upgrades the communicating information of display to user.
Compared with prior art, the invention has the beneficial effects as follows:
Without the need to the input equipment relying on mobile phone conventional keyboard, voice and Trackpad etc. fixing, also without the need to hand-held any sensing stage property, as long as mobile phone operation just can be completed in the inductive spacing of body sense equipment; The restriction of mobile phone operation interface is broken away from true display screen, user can adjust size and the resolution of virtual visual interface according to the hobby of oneself, realize mobile phone perspective operational, meet different user demands.Operation is freely, easy to use comfortable.
Accompanying drawing explanation
Fig. 1 is the operational flowchart of the smart mobile phone operative technique based on body sense technology.
Embodiment
Below in conjunction with accompanying drawing and embodiment, the present invention is described in further detail:
As shown in Figure 1, based on the mobile phone operation software of body sense technology, it comprises the following steps:
(1) body sense equipment is set, in the inductive spacing of body sense equipment, defines a virtual interface.
(2) preset gesture module, basic operation type has:
1. raise one's hand: interface is activated;
2. hand down: remove controls;
3. gesture is the palm: to movement and the rotation of virtual scene;
4. gesture is for thrusting out one's fingers: operational order selects object;
5. gesture is when clenching fist, operational order be capture selected by object;
(3) by the front-facing camera of mobile phone, camera is connected with mobile phone genuine interface, by shadow casting technique, mobile phone interface is projected to the interface in the inductive spacing of body sense equipment, make virtual interface visual.
(4) operating gesture of user and the movement locus in virtual visual interface thereof is identified, the gesture of identifying operation person can by the coordinate realization of the institute in this gesture of measuring and calculating a little in virtual visual interface, coordinate measurement and calculation, can realize based on stereovision technique.
(5) utilize the gesture template preset, gesture classification and movement locus are resolved, the action type that the gesture of analysis operation person is corresponding, obtain corresponding operational order.Concrete operations type is resolved, according to the starting point of movement locus, intermediate point and end point, and the threshold value preset, determine that described movement locus is camber line or rectilinear motion.
(6) corresponding operational order is changed into information by body sense equipment, conveys to mobile phone CPU and makes mobile phone interface fill order.
(7) camera is by the adjustment of mobile phone interface reaction on virtual visual interface, upgrades the communicating information of display to user.
The undeclared part related in the present invention is same as the prior art or adopt prior art to be realized.
Claims (2)
1. based on a smart mobile phone operative technique for body sense technology, it is characterized in that, comprising: body sense equipment is set, in the inductive spacing of body sense equipment, define a virtual interface; Preset gesture module, basic operation type has:
Raise one's hand: interface is activated; Hand down: remove controls; Gesture is the palm: to movement and the rotation of virtual scene; Gesture is for thrusting out one's fingers: operational order selects object; Gesture is when clenching fist, operational order be capture selected by object;
By the front-facing camera of mobile phone, camera is connected with mobile phone genuine interface, by shadow casting technique, mobile phone interface is projected to the interface in the inductive spacing of body sense equipment, make virtual interface visual;
Identify the operating gesture of user and the movement locus in virtual visual interface thereof, the gesture of identifying operation person can by the coordinate realization of the institute in this gesture of measuring and calculating a little in virtual visual interface, and coordinate measurement and calculation, can realize based on stereovision technique;
Utilize the gesture template preset, gesture classification and movement locus are resolved, the action type that the gesture of analysis operation person is corresponding, obtain corresponding operational order, concrete operations type is resolved, according to the starting point of movement locus, intermediate point and end point, and the threshold value preset, determine that described movement locus is camber line or rectilinear motion; Corresponding operational order is changed into information by body sense equipment, conveys to mobile phone CPU and makes mobile phone interface fill order;
The adjustment of mobile phone interface reaction on virtual visual interface, is upgraded the communicating information of display to user by camera.
2. virtual visualization interface according to claim 1, is characterized in that: described virtual visualization interface is by the front-facing camera imaging of mobile phone; Described virtual visualization interface can according to the gesture operation in prearranged gesture module, and user can adjust size and the resolution of virtual visual interface according to the hobby of oneself, meet different user demands.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310452146.5A CN104516649A (en) | 2013-09-28 | 2013-09-28 | Intelligent cell phone operating technology based on motion-sensing technology |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310452146.5A CN104516649A (en) | 2013-09-28 | 2013-09-28 | Intelligent cell phone operating technology based on motion-sensing technology |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104516649A true CN104516649A (en) | 2015-04-15 |
Family
ID=52792041
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310452146.5A Pending CN104516649A (en) | 2013-09-28 | 2013-09-28 | Intelligent cell phone operating technology based on motion-sensing technology |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104516649A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104951073A (en) * | 2015-06-19 | 2015-09-30 | 济南大学 | Gesture interaction method based on virtual interface |
| CN106095309A (en) * | 2016-06-03 | 2016-11-09 | 广东欧珀移动通信有限公司 | The method of controlling operation thereof of terminal and device |
| CN108196673A (en) * | 2017-12-29 | 2018-06-22 | 重庆敖汉科技有限公司 | Mobile phone input device based on body-sensing technology |
| CN109189312A (en) * | 2018-08-06 | 2019-01-11 | 北京理工大学 | A kind of human-computer interaction device and method for mixed reality |
| CN111045587A (en) * | 2019-10-29 | 2020-04-21 | 咪咕互动娱乐有限公司 | Game control method, electronic device, and computer-readable storage medium |
| CN112115853A (en) * | 2020-09-17 | 2020-12-22 | 西安羚控电子科技有限公司 | Gesture recognition method and device, computer storage medium and electronic equipment |
| CN112148120A (en) * | 2020-08-18 | 2020-12-29 | 华为技术有限公司 | Method, equipment and storage medium for displaying virtual interface |
-
2013
- 2013-09-28 CN CN201310452146.5A patent/CN104516649A/en active Pending
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104951073A (en) * | 2015-06-19 | 2015-09-30 | 济南大学 | Gesture interaction method based on virtual interface |
| CN104951073B (en) * | 2015-06-19 | 2017-03-29 | 济南大学 | A kind of gesture interaction method based on virtual interface |
| CN106095309A (en) * | 2016-06-03 | 2016-11-09 | 广东欧珀移动通信有限公司 | The method of controlling operation thereof of terminal and device |
| CN108196673A (en) * | 2017-12-29 | 2018-06-22 | 重庆敖汉科技有限公司 | Mobile phone input device based on body-sensing technology |
| CN109189312A (en) * | 2018-08-06 | 2019-01-11 | 北京理工大学 | A kind of human-computer interaction device and method for mixed reality |
| CN111045587A (en) * | 2019-10-29 | 2020-04-21 | 咪咕互动娱乐有限公司 | Game control method, electronic device, and computer-readable storage medium |
| CN111045587B (en) * | 2019-10-29 | 2024-02-09 | 咪咕互动娱乐有限公司 | Game control method, electronic device, and computer-readable storage medium |
| CN112148120A (en) * | 2020-08-18 | 2020-12-29 | 华为技术有限公司 | Method, equipment and storage medium for displaying virtual interface |
| CN112115853A (en) * | 2020-09-17 | 2020-12-22 | 西安羚控电子科技有限公司 | Gesture recognition method and device, computer storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104516649A (en) | Intelligent cell phone operating technology based on motion-sensing technology | |
| US20220129060A1 (en) | Three-dimensional object tracking to augment display area | |
| US8860675B2 (en) | Drawing aid system for multi-touch devices | |
| CA3051912C (en) | Gesture recognition devices and methods | |
| CN107665042B (en) | Enhanced virtual touchpad and touchscreen | |
| KR101872426B1 (en) | Depth-based user interface gesture control | |
| CN103472916B (en) | A kind of man-machine interaction method based on human body gesture identification | |
| CN102317892B (en) | The method of control information input media, message input device, program and information storage medium | |
| US20150084859A1 (en) | System and Method for Recognition and Response to Gesture Based Input | |
| US11907448B2 (en) | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment | |
| KR20160124786A (en) | In-air ultrasound pen gestures | |
| CN107291221B (en) | Across screen self-adaption accuracy method of adjustment and device based on natural gesture | |
| US11397478B1 (en) | Systems, devices, and methods for physical surface tracking with a stylus device in an AR/VR environment | |
| WO2012163124A1 (en) | Spatial motion-based input method and terminal | |
| CN106598422B (en) | hybrid control method, control system and electronic equipment | |
| CN105488832B (en) | Optical digital ruler | |
| KR101564089B1 (en) | Presentation Execution system using Gesture recognition. | |
| JP2014109888A (en) | Input device and program | |
| CN203070205U (en) | Input equipment based on gesture recognition | |
| CN108829329A (en) | A kind of operation object methods of exhibiting, device and readable medium | |
| JP2016118947A (en) | Spatial handwriting input system using angle-adjustable virtual plane | |
| JP2016110249A (en) | Spatial handwriting input system, spatial handwriting input method, and computer program | |
| CN110162251A (en) | Image-scaling method and device, storage medium, electronic equipment | |
| CN105528059B (en) | A kind of gesture operation in three-dimensional space method and system | |
| JP6523509B1 (en) | Game program, method, and information processing apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150415 |