CN101707649A - Method and system for interactively operating projection information and mobile terminal - Google Patents
Method and system for interactively operating projection information and mobile terminal Download PDFInfo
- Publication number
- CN101707649A CN101707649A CN200910190517A CN200910190517A CN101707649A CN 101707649 A CN101707649 A CN 101707649A CN 200910190517 A CN200910190517 A CN 200910190517A CN 200910190517 A CN200910190517 A CN 200910190517A CN 101707649 A CN101707649 A CN 101707649A
- Authority
- CN
- China
- Prior art keywords
- user
- module
- projection
- needs
- interface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a method and a system for interactively operating projection information and a mobile terminal. The method comprises the following steps: starting a projecting module of the mobile terminal to project an interface needing to interact with the mobile terminal; starting a camera module of the mobile terminal and acquiring operation information of a user for the projected interactive interface; analyzing an operational instruction of the user by the mobile terminal according to the acquired operation information of the user and carrying out corresponding operation on the interface needing to interact according to the operational instruction; and projecting the information of the corresponding operation carried out on the interface needing to interact in a projection region for the user to view by the projecting module. The invention integrates the functions of a projector and a camera on the mobile terminal without being externally connected with dedicated projection equipment, so cost is saved and a problem that the user can only operate on the mobile terminal is solved. The user can operate the interface in the region where the camera module can acquire a motion comprising an operation picture of the user. The region where the user operates the interface is enlarged so as to bring convenience to the operation of the user.
Description
Technical field
The present invention relates to communication technical field, more particularly, relate to a kind of interactive operation method, system and portable terminal of projection information.
Background technology
Nowadays, the portable terminal of compatible projector equipment is as the development communication technologies direction of a new generation, and it has brought facility for people's life, work, also more and more receives publicity and uses.For example, store development of projects information in the portable terminal, when carrying out project meeting interchange,, need carry out projection to the information operating interface of portable terminal and amplify usually conveniently to watch because mobile terminal screen is less.When the user need operate the interface that projection goes out, can only be on portable terminal operation interface, and go out interface after the operation by projection.Existing portable terminal shadow casting technique scheme wants interface displayed to project portable terminal mainly by the external special-purpose projector equipment of data-interface of the integrated special-purpose projecting apparatus of portable terminal.But this method can increase hardware cost, and can only be on portable terminal operation interface, and go out interface after the operation by projection, the zone that it has limited to user interface has influenced the convenience of user interface.
Summary of the invention
Embodiment of the invention technical problem to be solved is to provide a kind of cost lower and do not influence interactive operation method, system and the portable terminal of projection information of the convenience of user interface.
In order to solve the problems of the technologies described above, the invention provides a kind of interactive operation method of projection information, said method comprising the steps of:
Start the projection module of portable terminal, projection goes out portable terminal needs mutual interface;
Start the photographing module of portable terminal, gather the operation information of the interactive interface that the user goes out projection;
The user's operation information that the portable terminal basis collects analyzes user's operational order, according to described operational order corresponding operation is carried out at the mutual interface of needs;
To carry out corresponding operation information to the mutual interface of needs is projected to view field by described projection module and watches for the user.
The present invention also provides a kind of interactive operating system of projection information, and described system comprises:
Projection module is used for projection and goes out the mutual interface of portable terminal needs;
Photographing module is used to gather the operation information of the interactive interface that the user goes out projection;
Analysis module is used for analyzing according to the user's operation information that collects user's operational order;
The operational processes module is used for according to described operational order corresponding operation being carried out at the mutual interface of needs;
Described projection module is used for being projected to view field and watching for the user the mutual interface of needs being carried out corresponding operation information.
The present invention also provides a kind of portable terminal that comprises the interactive operating system of projection information recited above.
In the present invention, by integrated projection and camera function on portable terminal, it need not external special-purpose projector equipment, providing cost savings. the operation information of the interactive interface that projection is gone out according to the user that collects analyzes user's operational order in addition, according to described operational order corresponding operation is carried out at the mutual interface of needs; Avoided the user can only be on portable terminal operation interface, user of the present invention can collect the region operation interface of the action that comprises user's operation screen at photographing module, it has enlarged the zone of user interface, brings convenience to user interface.
Description of drawings
The invention will be further described below in conjunction with drawings and Examples, in the accompanying drawing:
Fig. 1 is the schematic flow sheet of the interactive operation method of the projection information that provides of the embodiment of the invention;
Fig. 2 is the structural representation of the interactive operating system of the projection information that provides of the embodiment of the invention;
Embodiment
See also Fig. 1, the interactive operation method of the projection information that provides for the embodiment of the invention said method comprising the steps of:
S1: start the projection module of portable terminal, projection goes out portable terminal needs mutual interface;
In embodiments of the present invention, for example, when the user need carry out project meeting interactive operation, start the projection module of portable terminal, the interface of mobile terminal that needs is carried out interactive operation carries out projection, forms the view field of a virtual operation interface.Wherein, because portable terminal has convenient flexible characteristic, projected background can be selected according to actual conditions, and it can be the object on any surfaces such as metope, the back of the hand in room for example.
S2: start the photographing module of portable terminal, gather the operation information of the interactive interface that the user goes out projection;
In embodiments of the present invention, start described photographing module after, the user is complete operation in the view field at interactive operation interface, mode of operation for example moves in interactive interface, slides or touch operation etc.Wherein, the user can stand or be seated, and also can operate by limb actions such as gestures, even can click in view field by infrared pen, as long as described photographing module can collect the action that comprises user's operation screen.Described photographing module collects the user and output it to portable terminal after the image of the view field of interface of mobile terminal operation or video information, this image or video information recording be image or video information about user's operation trace.
S3: the user's operation information that the portable terminal basis collects analyzes user's operational order, according to described operational order corresponding operation is carried out at the mutual interface of needs;
In embodiments of the present invention, step S3 is specially:
The image information that collects is divided the movement locus coordinate, set up the one-to-one relationship of this coordinate and mobile terminal touch screen coordinate;
Adopt Video Object Extraction technology and profile extractive technique among the MPEG-4, extract the profile and the movement locus thereof of user's finger; Wherein, the account form of the movement locus of user finger is specially: in the two adjacent images frame of determining to obtain in the coordinate of difference starting point obtain user's operation trace according to traveling time and distance to the traveling time and the distance of terminating point.
Described movement locus coordinate is reduced into the mobile terminal touch screen coordinate, according to the movement locus of described user finger original subscriber's operation trace also;
Instruction in reduction back user's operation trace and the instruction database is compared, judge which kind of operational order is described operation trace belong to;
According to described operational order corresponding operation is carried out at the mutual interface of needs.Wherein, in view field, pre-operation is carried out at the mutual interface of needs, simultaneously operation information is fed back to the user and confirm, go out dialog box by projection and confirm for the user according to described operational order.
S4: will carry out corresponding operation information to the mutual interface of needs and be projected to view field by described projection module and watch for the user.
As one embodiment of the present invention, the interactive operation method of described projection information, further comprising the steps of: as will to carry out corresponding operation information synchronously to the other side's portable terminal to the mutual interface of needs.
In embodiments of the present invention, the user confirms whether described operation information is correct, if described operation information is correct, then carries out and describedly will carry out the corresponding operation information step to the other side's portable terminal synchronously to the mutual interface of needs; If it is wrong that described user operates, then point out the user to operate again.Then return step S2, the user operates again.
Operation information after described portable terminal is confirmed the user feeds back to far-end with synchronization counterpart main frame and projection interface information, thereby finishes the mobile terminal remote interactive operation.
See also Fig. 2, the interactive operating system of the projection information that Fig. 2 provides for the embodiment of the invention for convenience of explanation, only shows part related to the present invention.Described system comprises projection module 10, photographing module 20, analysis module 30, operational processes module 40.The interactive operating system of described projection information can be the unit that is built in software unit, hardware cell or software and hardware combining in the portable terminal.Described photographing module can be camera.
When starting the projection module of portable terminal, projection module 10 projections go out portable terminal needs mutual interface; When starting the photographing module of portable terminal, photographing module 20 is gathered the operation information of the interactive interface that users go out projection; Analysis module 30 analyzes user's operational order according to the user's operation information that collects; Operational processes module 40 is carried out corresponding operation according to described operational order to the mutual interface of needs; Described projection module 10 will be carried out corresponding operation information to the mutual interface of needs and be projected to view field and watch for the user.
As one embodiment of the present invention, the interactive operating system of described projection information also comprises: synchronization module 50, described synchronization module 50 will be carried out corresponding operation information synchronously to the other side's portable terminal to the mutual interface of needs.
As another preferred embodiment of the present invention, the interactive operating system of described projection information also comprises: the pre-operation module.
Described pre-operation module is used in view field pre-operation being carried out at the mutual interface of needs according to the operational order that analyzes, and simultaneously operation information is fed back to the user and confirms; If described operation information is correct, then carries out and describedly will carry out the corresponding operation information step to the other side's portable terminal synchronously the mutual interface of needs; If it is wrong that described user operates, then point out the user to operate again.
In embodiments of the present invention, described analysis module 30 specifically comprises: set up module, extraction module, recovery module, comparing module and judge module.
The described module of setting up is used for the image information that collects is divided the movement locus coordinate, sets up the one-to-one relationship of this coordinate and mobile terminal touch screen coordinate; Described extraction module is used for extracting the profile and the movement locus thereof of image that photographing module 20 absorbs or video information user's finger; Recovery module is used for described movement locus coordinate is reduced into the mobile terminal touch screen coordinate, according to the movement locus of described user finger original subscriber's operation trace also; Comparing module is used for the instruction of reduction back user's operation trace and instruction database is compared, judge module is used for the decision operation track and belongs to which kind of operational order, and operational processes module 40 is carried out corresponding operation according to described operational order to the mutual interface of needs then.
Compared with prior art, the interactive operation method of projection information of the present invention, system and portable terminal are by integrated projection and camera function on portable terminal, it need not external special-purpose projector equipment, providing cost savings. the operation information of the interactive interface that projection is gone out according to the user that collects analyzes user's operational order in addition, according to described operational order corresponding operation is carried out at the mutual interface of needs; Avoided the user can only be on portable terminal operation interface, user of the present invention can collect the region operation interface of the action that comprises user's operation screen at photographing module, it has enlarged the zone of user interface, bring convenience to user interface. in addition, also can will carry out corresponding operation information to the mutual interface of needs synchronously to the other side's portable terminal, it is more convenient to make that the user uses portable terminal to carry out the remote interaction operation.
The above is the preferred embodiments of the present invention only, is not limited to the present invention, and for a person skilled in the art, the present invention can have various changes and variation.Within the spirit and principles in the present invention all, any modification of being done, be equal to replacement, improvement etc., all should be included within the claim scope of the present invention.
Claims (10)
1. the interactive operation method of a projection information is characterized in that, said method comprising the steps of:
Start the projection module of portable terminal, projection goes out portable terminal needs mutual interface;
Start the photographing module of portable terminal, gather the operation information of the interactive interface that the user goes out projection;
The user's operation information that the portable terminal basis collects analyzes user's operational order, according to described operational order corresponding operation is carried out at the mutual interface of needs;
To carry out corresponding operation information to the mutual interface of needs is projected to view field by described projection module and watches for the user.
2. method according to claim 1 is characterized in that, described method is further comprising the steps of:
To carry out corresponding operation information synchronously to the other side's portable terminal to the mutual interface of needs.
3. method according to claim 1 is characterized in that, the user's operation information that described portable terminal basis collects analyzes the step of user's operational order, is specially:
The image information that collects is divided the movement locus coordinate, set up the one-to-one relationship of this coordinate and mobile terminal touch screen coordinate;
Extract the profile and the movement locus thereof of user's finger;
Described movement locus coordinate is reduced into the mobile terminal touch screen coordinate, according to the movement locus of described user finger original subscriber's operation trace also;
Instruction in reduction back user's operation trace and the instruction database is compared, judge which kind of operational order is described operation trace belong to.
4. method according to claim 2 is characterized in that, and is described according to the step of described operational order to the mutual corresponding operation of interface execution of needs, is specially:
In view field, pre-operation is carried out at the mutual interface of needs according to described operational order, simultaneously operation information being fed back to the user confirms, if described operation information is correct, then carries out and describedly will carry out the corresponding operation information step to the other side's portable terminal synchronously the mutual interface of needs; If it is wrong that described user operates, then point out the user to operate again.
5. method according to claim 3 is characterized in that, the profile of the described user's of extracting finger and movement locus thereof are Video Object Extraction technology and the profile extractive techniques that adopts among the MPEG-4.
6. the interactive operating system of a projection information is characterized in that, described system comprises:
Projection module is used for projection and goes out the mutual interface of portable terminal needs;
Photographing module is used to gather the operation information of the interactive interface that the user goes out projection;
Analysis module is used for analyzing according to the user's operation information that collects user's operational order;
The operational processes module is used for according to described operational order corresponding operation being carried out at the mutual interface of needs;
Described projection module is used for being projected to view field and watching for the user the mutual interface of needs being carried out corresponding operation information.
7. system according to claim 6 is characterized in that, described system also comprises:
Synchronization module is used for and will corresponding operation information be carried out synchronously to the other side's portable terminal in the mutual interface of needs.
8. system according to claim 7 is characterized in that, described system also comprises:
The pre-operation module is used in view field pre-operation being carried out at the mutual interface of needs according to the operational order that analyzes, and simultaneously operation information is fed back to the user and confirms; If described operation information is correct, then carries out and describedly will carry out the corresponding operation information step to the other side's portable terminal synchronously the mutual interface of needs; If it is wrong that described user operates, then point out the user to operate again.
9. system according to claim 6 is characterized in that, described analysis module specifically comprises: set up module, extraction module, recovery module, comparing module and judge module;
The described module of setting up is used for the image information that collects is divided the movement locus coordinate, sets up the one-to-one relationship of this coordinate and mobile terminal touch screen coordinate;
Described extraction module is used for extracting the profile and the movement locus thereof of image that photographing module absorbs or video information user's finger;
Described recovery module is used for described movement locus coordinate is reduced into the mobile terminal touch screen coordinate, according to the movement locus of described user finger original subscriber's operation trace also;
Described comparing module is used for the instruction of reduction back user's operation trace and instruction database is compared,
Described judge module is used for the decision operation track and belongs to which kind of operational order, and described then operational processes module is carried out corresponding operation according to described operational order to the mutual interface of needs.
10. portable terminal that comprises the interactive operating system of each described projection information of claim 6 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910190517A CN101707649A (en) | 2009-09-29 | 2009-09-29 | Method and system for interactively operating projection information and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910190517A CN101707649A (en) | 2009-09-29 | 2009-09-29 | Method and system for interactively operating projection information and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101707649A true CN101707649A (en) | 2010-05-12 |
Family
ID=42377837
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910190517A Pending CN101707649A (en) | 2009-09-29 | 2009-09-29 | Method and system for interactively operating projection information and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101707649A (en) |
Cited By (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102073376A (en) * | 2010-12-07 | 2011-05-25 | 清华大学 | Portable wireless operation system and method |
| CN104133599A (en) * | 2014-08-01 | 2014-11-05 | 上海斐讯数据通信技术有限公司 | Terminal device and method allowing projection surface to be operated |
| CN104698827A (en) * | 2013-12-08 | 2015-06-10 | 崔允太 | Screen for smart watch |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| WO2015117350A1 (en) * | 2014-08-27 | 2015-08-13 | 中兴通讯股份有限公司 | Projection control method, projection device, and mobile terminal |
| CN104866170A (en) * | 2014-02-24 | 2015-08-26 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN105573692A (en) * | 2015-05-29 | 2016-05-11 | 宇龙计算机通信科技(深圳)有限公司 | Projection control method, associated terminal and system |
| CN105786300A (en) * | 2014-12-22 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105786164A (en) * | 2014-12-22 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105872508A (en) * | 2016-06-21 | 2016-08-17 | 北京印刷学院 | Projector based on intelligent cell phone and method for presenting multimedia |
| CN106095309A (en) * | 2016-06-03 | 2016-11-09 | 广东欧珀移动通信有限公司 | The method of controlling operation thereof of terminal and device |
| CN107015650A (en) * | 2017-03-28 | 2017-08-04 | 联想(北京)有限公司 | Alternative projection method, device and system |
| CN108200419A (en) * | 2018-03-30 | 2018-06-22 | 联想(北京)有限公司 | A kind of projecting method and electronic equipment |
| CN110032095A (en) * | 2019-03-13 | 2019-07-19 | 浙江帅康电气股份有限公司 | A kind of control method and control system of electric appliance |
| CN110855969A (en) * | 2019-12-06 | 2020-02-28 | 深圳乐信软件技术有限公司 | Projection method, device and system |
| CN112560572A (en) * | 2020-10-24 | 2021-03-26 | 北京博睿维讯科技有限公司 | Camera shooting and large screen interaction processing method, device and system |
| CN115143722A (en) * | 2021-03-31 | 2022-10-04 | 青岛海尔电冰箱有限公司 | Control method of refrigerating device |
-
2009
- 2009-09-29 CN CN200910190517A patent/CN101707649A/en active Pending
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102073376B (en) * | 2010-12-07 | 2012-11-14 | 清华大学 | Portable wireless operation system and method |
| CN102073376A (en) * | 2010-12-07 | 2011-05-25 | 清华大学 | Portable wireless operation system and method |
| CN104698827A (en) * | 2013-12-08 | 2015-06-10 | 崔允太 | Screen for smart watch |
| CN104866170B (en) * | 2014-02-24 | 2018-12-14 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN104866170A (en) * | 2014-02-24 | 2015-08-26 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104133599A (en) * | 2014-08-01 | 2014-11-05 | 上海斐讯数据通信技术有限公司 | Terminal device and method allowing projection surface to be operated |
| WO2015117350A1 (en) * | 2014-08-27 | 2015-08-13 | 中兴通讯股份有限公司 | Projection control method, projection device, and mobile terminal |
| CN105786300B (en) * | 2014-12-22 | 2019-01-15 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
| CN105786164A (en) * | 2014-12-22 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN105786300A (en) * | 2014-12-22 | 2016-07-20 | 联想(北京)有限公司 | Information processing method and electronic equipment |
| CN104808800A (en) * | 2015-05-21 | 2015-07-29 | 上海斐讯数据通信技术有限公司 | Smart glasses device, mobile terminal and operation method of mobile terminal |
| CN105573692A (en) * | 2015-05-29 | 2016-05-11 | 宇龙计算机通信科技(深圳)有限公司 | Projection control method, associated terminal and system |
| CN106095309A (en) * | 2016-06-03 | 2016-11-09 | 广东欧珀移动通信有限公司 | The method of controlling operation thereof of terminal and device |
| CN105872508A (en) * | 2016-06-21 | 2016-08-17 | 北京印刷学院 | Projector based on intelligent cell phone and method for presenting multimedia |
| CN107015650A (en) * | 2017-03-28 | 2017-08-04 | 联想(北京)有限公司 | Alternative projection method, device and system |
| CN107015650B (en) * | 2017-03-28 | 2020-10-27 | 联想(北京)有限公司 | Interactive projection method, device and system |
| CN108200419A (en) * | 2018-03-30 | 2018-06-22 | 联想(北京)有限公司 | A kind of projecting method and electronic equipment |
| CN110032095A (en) * | 2019-03-13 | 2019-07-19 | 浙江帅康电气股份有限公司 | A kind of control method and control system of electric appliance |
| CN110855969A (en) * | 2019-12-06 | 2020-02-28 | 深圳乐信软件技术有限公司 | Projection method, device and system |
| CN110855969B (en) * | 2019-12-06 | 2022-11-15 | 深圳乐信软件技术有限公司 | Projection method, device and system |
| CN112560572A (en) * | 2020-10-24 | 2021-03-26 | 北京博睿维讯科技有限公司 | Camera shooting and large screen interaction processing method, device and system |
| CN115143722A (en) * | 2021-03-31 | 2022-10-04 | 青岛海尔电冰箱有限公司 | Control method of refrigerating device |
| CN115143722B (en) * | 2021-03-31 | 2023-10-24 | 青岛海尔电冰箱有限公司 | Control method of refrigerating device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101707649A (en) | Method and system for interactively operating projection information and mobile terminal | |
| US6388654B1 (en) | Method and apparatus for processing, displaying and communicating images | |
| CN102446032B (en) | Information input method and terminal based on camera | |
| WO2017101440A1 (en) | Remote annotation synchronization method and system | |
| EP2790089A1 (en) | Portable device and method for providing non-contact interface | |
| CN103873811A (en) | Information processing apparatus, information processing method, and information processing system | |
| KR20140027850A (en) | Method for providing user interface, machine-readable storage medium and portable terminal | |
| CN102063231A (en) | Non-contact electronic whiteboard system and detection method based on image detection | |
| CN103019537A (en) | Image preview method and image preview device | |
| JP2008118301A (en) | Electronic blackboard system | |
| CN103888685A (en) | Display control method and system for tiled display device | |
| CN103034042A (en) | Panoramic shooting method and device | |
| CN105657304A (en) | Method and apparatus for controlling projection display | |
| CN102945077A (en) | Image viewing method and device and intelligent terminal | |
| CN102750134A (en) | Method for generating graphical interface of handheld terminal operating system and handheld terminal | |
| KR20110053396A (en) | Apparatus and method for providing user interface by gesture | |
| CN102999232A (en) | Imitated mouse interaction method for implementing oversize interactive electronic white board | |
| CN105991968A (en) | Camouflage/recovery system of display equipment and control method thereof | |
| CN110069101A (en) | A kind of wearable calculating equipment and a kind of man-machine interaction method | |
| US8818174B2 (en) | Reproduction apparatus and control method therefor | |
| CN106033286A (en) | A projection display-based virtual touch control interaction method and device and a robot | |
| CN102984563A (en) | Intelligent remote controlled television system and remote control method thereof | |
| CN103577109A (en) | Touch assistant system capable of capturing interface colors and realizing method thereof | |
| CN202058115U (en) | Mouse controlling means based on mouse laser pen | |
| CN107272910B (en) | Projection interaction method and system based on rock climbing project |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20100512 |