CN105320249A - Interactive method for reality enhancement - Google Patents
Interactive method for reality enhancement Download PDFInfo
- Publication number
- CN105320249A CN105320249A CN201410261455.9A CN201410261455A CN105320249A CN 105320249 A CN105320249 A CN 105320249A CN 201410261455 A CN201410261455 A CN 201410261455A CN 105320249 A CN105320249 A CN 105320249A
- Authority
- CN
- China
- Prior art keywords
- reality
- strengthens
- images
- thermal infrared
- app
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Landscapes
- Studio Devices (AREA)
- Image Processing (AREA)
- Radiation Pyrometers (AREA)
Abstract
The embodiment of the invention provides an interactive method for reality enhancement. According to the interactive method, a visible light image is captured based on a thermosensitive reality enhancement interactive device; a thermal infrared image is captured; calculation is conducted according to the visible light image and the thermal infrared image to obtain an operation instruction so as to achieve reality enhancement. By the adoption of the interactive method for reality enhancement, residual heat of a human body touching a real world object can be utilized for obtaining the operation instruction of the real world object, and then interactive operation for reality enhancement is achieved more easily and effectively.
Description
Technical field
The present invention relates to Internet of Things reality enhancing field, the exchange method that especially a kind of reality strengthens.
Background technology
The practice of technology of Internet of things can trace back to the laughable machine for vending of network of nineteen ninety Xerox the earliest, and along with the extreme enrichment of the development of Internet technology and various hardware, application software, technology of Internet of things have also been obtained great development.Internet of Things is regarded as the application extension of internet, and the essence of Internet of Things sums up and is mainly reflected in three aspects: one is internet feature, namely to needing the thing of networking must realize the internet interconnected; Two is identify and communication feature, and " thing " of namely including Internet of Things in must possess the function automatically identifying and communicate with thing thing; Three is intelligent features, and namely network system should have the feature of robotization, self-feedback and Based Intelligent Control.
At present, very many to the embody ruleization of technology of Internet of things, such as Smart Home technology, by network each system relationship management in family, unified control; Such as car networking technology again, is associated the vehicle in a region by network, realizes monitoring, scheduling, tracking etc. application.Put forward a lot of future thrust at present, large as the wisdom earth, smart city, littlely can predict to wisdom water utilities, wisdom combustion gas etc., take technology of Internet of things as work and the life that the next generation internet technology of core will change people greatly.
The main idea of technology of Internet of things is exactly that thing thing is connected, information mutual communication.Intel Virtualization Technology is applied at present in Internet of Things, create some new reality and strengthen application, Google's glasses that famous such as Google releases, by small projector, virtual data is projected on eyeglass, the reality achieving wearing spectacles strengthens, thus virtual technology and real enhancing technology can be applied with oneself, overcome fixed position and equipment white elephant, make real enhancing technology obtain larger application space.But Google's glasses are in input and control to still have problem, although Google's glasses can be inputted by the mode of gesture, voice, but precision and operation still can not meet the demands comparatively speaking, this is also the problem must considered after the miniaturization of real enhancing technology and portability, how under present circumstances, more simple, the input mode of reality enhancing is reliably realized.
Summary of the invention
The embodiment of the present invention proposes the exchange method that a kind of reality strengthens, and strengthens interactive device catch visible images based on temperature-sensitive reality; Catch thermal infrared images; Calculate according to visible images and thermal infrared images and obtain the enhancing of operational order realization reality.
Further, described based on temperature-sensitive reality enhancing interactive device, comprise, infrared temperature-sensitive camera, for the thermal infrared images of capturing ambient; Visible image capturing head, for the visible images of capturing ambient; Reality strengthens APP, for receiving described thermal infrared images and described visible images, and calculates acquisition operational order; Computing machine, for the computing providing reality to strengthen APP; The described thermal infrared images being obtained environment based on temperature-sensitive reality enhancing interactive device by described infrared temperature-sensitive camera, the visible images of environment is obtained by light video camera head, described thermal infrared images and visible images are transferred to the described reality be arranged on described computing machine and strengthen APP, strengthen APP by described reality and calculate operational order and perform.
Further, described reality enhancing APP is arranged on described computing machine.
Further, described reality strengthens APP and obtains the waste heat signal that in described thermal infrared images, human body touching produces, and is converted into operational order.
Further, described reality strengthens the instruction of APP executable operations, operation is superimposed upon on described visible images.
The exchange method that the reality that the embodiment of the present invention provides strengthens, after human body and real-world objects can be utilized to touch, residual heat realizes the operational order to real-world objects, thus the interactive operation that reality is strengthened is more simple and efficient.
Accompanying drawing explanation
Fig. 1 shows based on temperature-sensitive reality enhancing interactive device structural drawing;
Fig. 2 shows the exchange method process flow diagram that reality strengthens;
Fig. 3 is the another kind of process flow diagram of exchange method that reality strengthens.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, example of the present invention is shown in the drawings, although will describe the present invention in conjunction with these embodiments, should be appreciated that it does not really want to limit the invention to these embodiments.On the contrary, this invention is intended to cover the replacement that can be included in spirit and scope that claims limit, amendment and equivalents.In addition, in the following detailed description of the embodiment of the present invention, propose a lot of detail and thoroughly understood to make the present invention.But, persons of ordinary skill in the art will recognize that and do not have these details also can implement the present invention.In other example, in order to unnecessarily fuzzy aspect of the present invention, do not describe known method, process, parts and circuit in detail.
The some parts below described in detail represents according to process, step, logical block, process and other symbol to the operation of the data bit that can perform on computer memory to propose.These describe and represent be the technician of data processing field use, in order to the essence of its work being conveyed to most effectively the means of other technician of this field.Here, process, computing machine perform step, logical block, process etc. be usually envisioned for cause the step of expected result or instruction be certainly in harmony sequence.Described step is the step of the physical manipulation needed physical quantity.Usually, although unnecessary, this tittle adopts the form of the electrical or magnetic signal that can store in computer systems, which, transmit, combine, relatively or in addition handle.Verified, mainly in order to the reason of public use, it is easily sometimes that these signals are called position, value, element, symbol, character, project, numeral etc.
But should keep firmly in mind, all these should be associated with suitable physical quantity with similar term and be only be applicable to the convenient of this tittle mark.Unless specifically stated otherwise, otherwise institute is apparent as described below, should understand in whole the present invention, term used is discussed, as " association " or " identification " or " reproduction " or " needs " or " determination " or " repetition " or " execution " or " detection " or " guiding " etc., refer to action and the process of electronic system or similar electronic computing device, its by the RS of electronic equipment be expressed as data manipulation that physics (electronics) measures and the such information of electronic device memory or register or other that is transformed into stores, transmission or display device in other data being expressed as physical quantity similarly.
Fig. 1 explanation strengthens interactive device structural drawing according to the displaying of various exemplary embodiments of the present invention based on temperature-sensitive reality.
In Fig. 1, strengthen interactive device 100 based on temperature-sensitive reality and be in true environment, in true environment, also comprise the people be in true environment and the object 300 be in true environment.Wherein, in the present embodiment, setting people adopts hand to carry out operation interactive, therefore staff 200 can and true environment object 300 between come in contact thus produce the transmission of heat, namely, staff 200 can and true environment object 300 between there is exchange heat, thus make staff 200 touch true environment object 300 position produce moment heat mark, this heat mark by heat-sensing device can perception.
Strengthen interactive device 100 based on temperature-sensitive reality and comprise visible image capturing 101, infrared temperature-sensitive camera 102, computing machine 104, and the reality of installing on computers strengthens APP103.
Visible image capturing 101, for the visible images of capturing ambient.The problem of visible image capturing 101 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
Infrared temperature-sensitive camera 102, for the thermal infrared images of capturing ambient, the problem of infrared temperature-sensitive camera 102 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
Reality strengthens APP103, for receiving the thermal infrared images and described visible image capturing 101 visible images of catching that described infrared temperature-sensitive camera 102 catches, and calculates and obtains operational order.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
Wherein in an embodiment, this heat mark retention time is less than or equal to 0.5 second, and corresponding operational order is single-click operation, and this heat mark retention time is greater than 0.5 second, and corresponding operational order is double click operation.
Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
Computing machine 104, strengthens APP103 for installing reality and provides computational resource.
Wherein in an embodiment, computing machine 104 can be portable electric appts, such as smart mobile phone, and intelligent glasses etc. can mounting software provide the electronic equipment of computational resource.
Fig. 2 illustrates the exchange method process flow diagram that wherein a kind of embodiment reality strengthens.
201, visible image capturing head catches visible images.The problem of visible image capturing 101 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
202, infrared temperature-sensitive camera catches thermal infrared images.The problem of infrared temperature-sensitive camera 102 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
203, reality strengthens APP and receives visible images and thermal infrared images.The thermal infrared images that the described infrared temperature-sensitive camera 102 of reality enhancing APP103 reception is caught and described visible image capturing 101 visible images of catching.
204, reality strengthens APP and calculates acquisition operational order.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
205, reality strengthens APP and completes instruction action.Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
Fig. 3 illustrates the exchange method process flow diagram that another embodiment reality strengthens.
301, the initialization of infrared temperature-sensitive camera.Infrared temperature-sensitive camera 102 is started shooting, and catches the thermal infrared images of current environment, and calculates the temperature environment value of current environment, i.e. current operation environment temperature, as context initialization temperature value.
302, operator operating position is located.Visible image capturing 101 and infrared temperature-sensitive camera 102 obtain visible images containing operator operating position and thermal infrared images respectively, and carry out this operating position of image recognition, such as staff 200, the hot value of thermal infrared images to staff 200 marks, and corresponds to operating position temperature value.
303, reality strengthens APP initialization.Reality enhancing APP environmentally initialization temperature value, operating position temperature value sets up model of cognition, that is, according to the difference of these two temperature, leave the temperature profile value of heat mark after calculating operation position contacts with surrounding environment, and heat mark retention time eigenwert.
304, reality strengthens APP and obtains visible images and thermal infrared images.Reality strengthens APP103, does not stop continuously to receive described infrared temperature-sensitive camera 102 thermal infrared images of catching and described visible image capturing 101 visible images of catching.
305, reality strengthens APP calculating operation instruction and performs.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
Wherein in an embodiment, this heat mark retention time is less than or equal to 0.5 second, and corresponding operational order is single-click operation, and this heat mark retention time is greater than 0.5 second, and corresponding operational order is double click operation.
Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
The above is the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications are also considered as protection scope of the present invention.
Claims (4)
1. an exchange method for reality enhancing, is characterized in that, strengthens interactive device catch visible images based on temperature-sensitive reality; Catch thermal infrared images; Calculate according to visible images and thermal infrared images and obtain the enhancing of operational order realization reality.
2. the exchange method of reality enhancing as claimed in claim 1, is characterized in that, strengthen interactive device based on temperature-sensitive reality and comprise, infrared temperature-sensitive camera, for the thermal infrared images of capturing ambient; Visible image capturing head, for the visible images of capturing ambient; Reality strengthens APP, for receiving described thermal infrared images and described visible images, and calculates acquisition operational order; Computing machine, for the computing providing reality to strengthen APP; The exchange method that described reality strengthens obtains the thermal infrared images of environment by described infrared temperature-sensitive camera, the visible images of environment is obtained by light video camera head, described thermal infrared images and visible images are transferred to the described reality be arranged on described computing machine and strengthen APP, strengthen APP by described reality and calculate operational order and perform
The exchange method that reality as claimed in claim 2 strengthens, is characterized in that, described reality strengthens APP and is arranged on described computing machine.
3. the exchange method of reality enhancing as claimed in claim 2, is characterized in that, described reality strengthens APP and obtains the waste heat signal that in described thermal infrared images, human body touching produces, and is converted into operational order.
4. the exchange method of reality enhancing as claimed in claim 2, is characterized in that, described reality strengthens the instruction of APP executable operations, operation is superimposed upon on described visible images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410261455.9A CN105320249A (en) | 2014-06-13 | 2014-06-13 | Interactive method for reality enhancement |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410261455.9A CN105320249A (en) | 2014-06-13 | 2014-06-13 | Interactive method for reality enhancement |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105320249A true CN105320249A (en) | 2016-02-10 |
Family
ID=55247797
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410261455.9A Pending CN105320249A (en) | 2014-06-13 | 2014-06-13 | Interactive method for reality enhancement |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105320249A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109621401A (en) * | 2018-12-29 | 2019-04-16 | 广州明朝互动科技股份有限公司 | Interactive game system and control method |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101945224A (en) * | 2009-07-01 | 2011-01-12 | 弗卢克公司 | Thermal imaging method |
| US20120056847A1 (en) * | 2010-07-20 | 2012-03-08 | Empire Technology Development Llc | Augmented reality proximity sensing |
| CN105992988A (en) * | 2014-02-17 | 2016-10-05 | Metaio有限公司 | Method and device for detecting a touch between a first object and a second object |
-
2014
- 2014-06-13 CN CN201410261455.9A patent/CN105320249A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101945224A (en) * | 2009-07-01 | 2011-01-12 | 弗卢克公司 | Thermal imaging method |
| US20120056847A1 (en) * | 2010-07-20 | 2012-03-08 | Empire Technology Development Llc | Augmented reality proximity sensing |
| CN105992988A (en) * | 2014-02-17 | 2016-10-05 | Metaio有限公司 | Method and device for detecting a touch between a first object and a second object |
Non-Patent Citations (1)
| Title |
|---|
| DAISUKE IWAI等: "Document search support by making physical documents transparent in projection-based mixed reality", 《VIRTUAL REALITY》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109621401A (en) * | 2018-12-29 | 2019-04-16 | 广州明朝互动科技股份有限公司 | Interactive game system and control method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111694429B (en) | Virtual object driving method and device, electronic equipment and readable storage | |
| Betancourt et al. | The evolution of first person vision methods: A survey | |
| WO2020228643A1 (en) | Interactive control method and apparatus, electronic device and storage medium | |
| JP6502370B2 (en) | Eye tracking based on adaptive homography mapping | |
| Dubey et al. | A comprehensive survey on human pose estimation approaches | |
| EP2974509B1 (en) | Personal information communicator | |
| CN112001248B (en) | Active interaction method, device, electronic equipment and readable storage medium | |
| CN112487973B (en) | Updating method and device for user image recognition model | |
| CN113359995B (en) | Man-machine interaction method, device, equipment and storage medium | |
| WO2023168957A1 (en) | Pose determination method and apparatus, electronic device, storage medium, and program | |
| CN115061577B (en) | Hand projection interaction method, system and storage medium | |
| Song et al. | Joint estimation of 3D hand position and gestures from monocular video for mobile interaction | |
| CN202159302U (en) | Augment reality system with user interaction and input functions | |
| CN112486394A (en) | Information processing method and device, electronic equipment and readable storage medium | |
| CN112241704A (en) | Method and device for judging portrait infringement, electronic equipment and storage medium | |
| CN115223248A (en) | Hand gesture recognition method, and training method and device of hand gesture recognition model | |
| Yang et al. | Smart control of home appliances using hand gesture recognition in an IoT-enabled system | |
| JP2016115125A (en) | Wearable search system | |
| Merino‐Gracia et al. | Real‐time text tracking in natural scenes | |
| US9569661B2 (en) | Apparatus and method for neck and shoulder landmark detection | |
| CN105278658A (en) | Display enhancing method based on temperature-sensitive | |
| CN104134070A (en) | Interactive object tracking system and interactive object tracking method thereof | |
| CN112580563A (en) | Video abstract generation method and device, electronic equipment and storage medium | |
| CN112488126A (en) | Feature map processing method, device, equipment and storage medium | |
| CN109725722B (en) | Gesture control method and device for screen equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160210 |