CN105302282A - Thermo-sensitivity based reality augmentation system - Google Patents
Thermo-sensitivity based reality augmentation system Download PDFInfo
- Publication number
- CN105302282A CN105302282A CN201410261466.7A CN201410261466A CN105302282A CN 105302282 A CN105302282 A CN 105302282A CN 201410261466 A CN201410261466 A CN 201410261466A CN 105302282 A CN105302282 A CN 105302282A
- Authority
- CN
- China
- Prior art keywords
- reality
- temperature
- sensitive
- images
- thermal infrared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
An embodiment of the present invention discloses a thermo-sensitivity based reality augmentation system. The system comprises a real environment object, a human hand and a thermo-sensitivity based reality augmentation interactive apparatus. According to the thermo-sensitivity based reality augmentation interactive apparatus, visible light images and thermal infrared images of the real environment object and/or the human hand are captured; according to hot stamps on the thermal infrared images, calculation is carried out to obtain an operation instruction; and according to the operation instruction, reality augmentation is realized. According to the thermo-sensitivity based reality augmentation system provided by the embodiment of the present invention, the operation instruction on a real world object can be realized by utilizing residual heat generated after a human body touches the real world object, thereby enabling the interactive operation of the reality augmentation to be simpler and more efficient.
Description
Technical field
The present invention relates to Internet of Things reality enhancing field, especially a kind of based on temperature-sensitive reality enhancing interactive device.
Background technology
The practice of technology of Internet of things can trace back to the laughable machine for vending of network of nineteen ninety Xerox the earliest, and along with the extreme enrichment of the development of Internet technology and various hardware, application software, technology of Internet of things have also been obtained great development.Internet of Things is regarded as the application extension of internet, and the essence of Internet of Things sums up and is mainly reflected in three aspects: one is internet feature, namely to needing the thing of networking must realize the internet interconnected; Two is identify and communication feature, and " thing " of namely including Internet of Things in must possess the function automatically identifying and communicate with thing thing; Three is intelligent features, and namely network system should have the feature of robotization, self-feedback and Based Intelligent Control.
At present, very many to the embody ruleization of technology of Internet of things, such as Smart Home technology, by network each system relationship management in family, unified control; Such as car networking technology again, is associated the vehicle in a region by network, realizes monitoring, scheduling, tracking etc. application.Put forward a lot of future thrust at present, large as the wisdom earth, smart city, littlely can predict to wisdom water utilities, wisdom combustion gas etc., take technology of Internet of things as work and the life that the next generation internet technology of core will change people greatly.
The main idea of technology of Internet of things is exactly that thing thing is connected, information mutual communication.Intel Virtualization Technology is applied at present in Internet of Things, create some new reality and strengthen application, Google's glasses that famous such as Google releases, by small projector, virtual data is projected on eyeglass, the reality achieving wearing spectacles strengthens, thus virtual technology and real enhancing technology can be applied with oneself, overcome fixed position and equipment white elephant, make real enhancing technology obtain larger application space.But Google's glasses are in input and control to still have problem, although Google's glasses can be inputted by the mode of gesture, voice, but precision and operation still can not meet the demands comparatively speaking, this is also the problem must considered after the miniaturization of real enhancing technology and portability, how under present circumstances, more simple, the input mode of reality enhancing is reliably realized.
Summary of the invention
The embodiment of the present invention proposes a kind of reality based on temperature-sensitive and strengthens system, comprise, true environment object, staff and based on temperature-sensitive reality strengthen interactive device, described visible images and thermal infrared images of catching true environment object and/or staff based on temperature-sensitive reality enhancing interactive device, and calculate acquisition operational order according to the heat mark on described thermal infrared images, realize reality according to operational order and strengthen.
Further, described based on temperature-sensitive reality enhancing interactive device, comprise, infrared temperature-sensitive camera, for the thermal infrared images of capturing ambient; Visible image capturing head, for the visible images of capturing ambient; Reality strengthens APP, for receiving described thermal infrared images and described visible images, and calculates acquisition operational order; Computing machine, for the computing providing reality to strengthen APP; The described thermal infrared images being obtained environment based on temperature-sensitive reality enhancing interactive device by described infrared temperature-sensitive camera, the visible images of environment is obtained by light video camera head, described thermal infrared images and visible images are transferred to the described reality be arranged on described computing machine and strengthen APP, strengthen APP by described reality and calculate operational order and perform.
Further, described reality enhancing APP is arranged on described computing machine.
Further, described reality strengthens APP and obtains the waste heat signal that in described thermal infrared images, human body touching produces, and is converted into operational order.
Further, described reality strengthens the instruction of APP executable operations, operation is superimposed upon on described visible images.
The reality based on temperature-sensitive that the embodiment of the present invention provides strengthens system, and heat residual after human body and real-world objects can be utilized to touch realizes the operational order to real-world objects, thus the interactive operation that reality is strengthened is more simple and efficient.
Accompanying drawing explanation
Fig. 1 shows that the reality based on temperature-sensitive strengthens system construction drawing;
Fig. 2 shows that the reality based on temperature-sensitive strengthens working-flow figure;
Fig. 3 is the another kind of workflow diagram of reality enhancing system based on temperature-sensitive.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, technical scheme in the embodiment of the present invention is clearly and completely described, example of the present invention is shown in the drawings, although will describe the present invention in conjunction with these embodiments, should be appreciated that it does not really want to limit the invention to these embodiments.On the contrary, this invention is intended to cover the replacement that can be included in spirit and scope that claims limit, amendment and equivalents.In addition, in the following detailed description of the embodiment of the present invention, propose a lot of detail and thoroughly understood to make the present invention.But, persons of ordinary skill in the art will recognize that and do not have these details also can implement the present invention.In other example, in order to unnecessarily fuzzy aspect of the present invention, do not describe known method, process, parts and circuit in detail.
The some parts below described in detail represents according to process, step, logical block, process and other symbol to the operation of the data bit that can perform on computer memory to propose.These describe and represent be the technician of data processing field use, in order to the essence of its work being conveyed to most effectively the means of other technician of this field.Here, process, computing machine perform step, logical block, process etc. be usually envisioned for cause the step of expected result or instruction be certainly in harmony sequence.Described step is the step of the physical manipulation needed physical quantity.Usually, although unnecessary, this tittle adopts the form of the electrical or magnetic signal that can store in computer systems, which, transmit, combine, relatively or in addition handle.Verified, mainly in order to the reason of public use, it is easily sometimes that these signals are called position, value, element, symbol, character, project, numeral etc.
But should keep firmly in mind, all these should be associated with suitable physical quantity with similar term and be only be applicable to the convenient of this tittle mark.Unless specifically stated otherwise, otherwise institute is apparent as described below, should understand in whole the present invention, term used is discussed, as " association " or " identification " or " reproduction " or " needs " or " determination " or " repetition " or " execution " or " detection " or " guiding " etc., refer to action and the process of electronic system or similar electronic computing device, its by the RS of electronic equipment be expressed as data manipulation that physics (electronics) measures and the such information of electronic device memory or register or other that is transformed into stores, transmission or display device in other data being expressed as physical quantity similarly.
Fig. 1 explanation is according to the reality enhancing system construction drawing of the displaying of various exemplary embodiments of the present invention based on temperature-sensitive.
In Fig. 1, reality based on temperature-sensitive strengthens system, comprise, true environment object 300, staff 200 and based on temperature-sensitive reality strengthen interactive device 100, described visible images and thermal infrared images of catching true environment object and/or staff based on temperature-sensitive reality enhancing interactive device 100, and calculate acquisition operational order according to the heat mark on described thermal infrared images, realize reality enhancing according to operational order
Strengthening interactive device 100 based on temperature-sensitive reality is in true environment, also comprises the people be in true environment and the object 300 be in true environment in true environment.Wherein, in the present embodiment, setting people adopts hand to carry out operation interactive, therefore staff 200 can and true environment object 300 between come in contact thus produce the transmission of heat, namely, staff 200 can and true environment object 300 between there is exchange heat, thus make staff 200 touch true environment object 300 position produce moment heat mark, this heat mark by heat-sensing device can perception.
Strengthen interactive device 100 based on temperature-sensitive reality and comprise visible image capturing 101, infrared temperature-sensitive camera 102, computing machine 104, and the reality of installing on computers strengthens APP103.
Visible image capturing 101, for the visible images of capturing ambient.The problem of visible image capturing 101 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
Infrared temperature-sensitive camera 102, for the thermal infrared images of capturing ambient, the problem of infrared temperature-sensitive camera 102 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
Reality strengthens APP103, for receiving the thermal infrared images and described visible image capturing 101 visible images of catching that described infrared temperature-sensitive camera 102 catches, and calculates and obtains operational order.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
Wherein in an embodiment, this heat mark retention time is less than or equal to 0.5 second, and corresponding operational order is single-click operation, and this heat mark retention time is greater than 0.5 second, and corresponding operational order is double click operation.
Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
Computing machine 104, strengthens APP103 for installing reality and provides computational resource.
Wherein in an embodiment, computing machine 104 can be portable electric appts, such as smart mobile phone, and intelligent glasses etc. can mounting software provide the electronic equipment of computational resource.
Fig. 2 illustrates wherein a kind of embodiment and strengthens working-flow figure based on the reality of temperature-sensitive.
201, visible image capturing head catches visible images.The problem of visible image capturing 101 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
202, infrared temperature-sensitive camera catches thermal infrared images.The problem of infrared temperature-sensitive camera 102 pairs of true environments is made a video recording, and obtains real-time true environment visible images, especially comprises the true environment object 300 that staff 200 and staff 200 carry out operating.
203, reality strengthens APP and receives visible images and thermal infrared images.The thermal infrared images that the described infrared temperature-sensitive camera 102 of reality enhancing APP103 reception is caught and described visible image capturing 101 visible images of catching.
204, reality strengthens APP and calculates acquisition operational order.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
205, reality strengthens APP and completes instruction action.Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
Fig. 3 illustrates the reality enhancing working-flow figure of another embodiment based on temperature-sensitive.
301, the initialization of infrared temperature-sensitive camera.Infrared temperature-sensitive camera 102 is started shooting, and catches the thermal infrared images of current environment, and calculates the temperature environment value of current environment, i.e. current operation environment temperature, as context initialization temperature value.
302, operator operating position is located.Visible image capturing 101 and infrared temperature-sensitive camera 102 obtain visible images containing operator operating position and thermal infrared images respectively, and carry out this operating position of image recognition, such as staff 200, the hot value of thermal infrared images to staff 200 marks, and corresponds to operating position temperature value.
303, reality strengthens APP initialization.Reality enhancing APP environmentally initialization temperature value, operating position temperature value sets up model of cognition, that is, according to the difference of these two temperature, leave the temperature profile value of heat mark after calculating operation position contacts with surrounding environment, and heat mark retention time eigenwert.
304, reality strengthens APP and obtains visible images and thermal infrared images.Reality strengthens APP103, does not stop continuously to receive described infrared temperature-sensitive camera 102 thermal infrared images of catching and described visible image capturing 101 visible images of catching.
305, reality strengthens APP calculating operation instruction and performs.This computation process comprises, and analyzes thermal infrared images, obtains the heat mark that on image, staff 200 leaves on true environment object 300.This heat mark is owing to coming in contact between staff 200 and true environment object 300 thus producing the transmission of heat, namely, staff 200 can and true environment object 300 between there is the obvious region of moment heat that exchange heat produces, and the time retained according to this heat mark and area size obtain corresponding operational order.
Wherein in an embodiment, this heat mark retention time is less than or equal to 0.5 second, and corresponding operational order is single-click operation, and this heat mark retention time is greater than 0.5 second, and corresponding operational order is double click operation.
Reality strengthens APP103 in the instruction of visible images complete operation, realizes reality and strengthens.
The above is the preferred embodiment of the present invention; it should be pointed out that for those skilled in the art, under the premise without departing from the principles of the invention; can also make some improvements and modifications, these improvements and modifications are also considered as protection scope of the present invention.
Claims (5)
1. the reality based on temperature-sensitive strengthens system, it is characterized in that, comprise, true environment object, staff and based on temperature-sensitive reality strengthen interactive device, described visible images and thermal infrared images of catching true environment object and/or staff based on temperature-sensitive reality enhancing interactive device, and calculate acquisition operational order according to the heat mark on described thermal infrared images, realize reality enhancing according to operational order.
2. as claimed in claim 1 strengthen system based on the reality of temperature-sensitive, it is characterized in that, describedly strengthen interactive device based on temperature-sensitive reality and comprise, infrared temperature-sensitive camera, for the thermal infrared images of capturing ambient; Visible image capturing head, for the visible images of capturing ambient; Reality strengthens APP, for receiving described thermal infrared images and described visible images, and calculates acquisition operational order; Computing machine, for the computing providing reality to strengthen APP; The described reality based on temperature-sensitive strengthens system obtains environment thermal infrared images by described infrared temperature-sensitive camera, the visible images of environment is obtained by light video camera head, described thermal infrared images and visible images are transferred to the described reality be arranged on described computing machine and strengthen APP, strengthen APP by described reality and calculate operational order and perform.
3. strengthen system based on the reality of temperature-sensitive as claimed in claim 1, it is characterized in that, described reality strengthens APP and is arranged on described computing machine.
4. strengthen system based on the reality of temperature-sensitive as claimed in claim 1, it is characterized in that, described reality strengthens APP and obtains the waste heat signal that in described thermal infrared images, human body touching produces, and is converted into operational order.
5. strengthen system based on the reality of temperature-sensitive as claimed in claim 1, it is characterized in that, described reality strengthens the instruction of APP executable operations, operation is superimposed upon on described visible images.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410261466.7A CN105302282A (en) | 2014-06-13 | 2014-06-13 | Thermo-sensitivity based reality augmentation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410261466.7A CN105302282A (en) | 2014-06-13 | 2014-06-13 | Thermo-sensitivity based reality augmentation system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105302282A true CN105302282A (en) | 2016-02-03 |
Family
ID=55199642
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410261466.7A Pending CN105302282A (en) | 2014-06-13 | 2014-06-13 | Thermo-sensitivity based reality augmentation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105302282A (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101945224A (en) * | 2009-07-01 | 2011-01-12 | 弗卢克公司 | Thermal imaging method |
| US20120056847A1 (en) * | 2010-07-20 | 2012-03-08 | Empire Technology Development Llc | Augmented reality proximity sensing |
| CN105992988A (en) * | 2014-02-17 | 2016-10-05 | Metaio有限公司 | Method and device for detecting a touch between a first object and a second object |
-
2014
- 2014-06-13 CN CN201410261466.7A patent/CN105302282A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101945224A (en) * | 2009-07-01 | 2011-01-12 | 弗卢克公司 | Thermal imaging method |
| US20120056847A1 (en) * | 2010-07-20 | 2012-03-08 | Empire Technology Development Llc | Augmented reality proximity sensing |
| CN105992988A (en) * | 2014-02-17 | 2016-10-05 | Metaio有限公司 | Method and device for detecting a touch between a first object and a second object |
Non-Patent Citations (1)
| Title |
|---|
| DAISUKE IWAI等: "Document search support by making physical documents transparent in projection-based mixed reality", 《VIRTUAL REALITY》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111694429B (en) | Virtual object driving method and device, electronic equipment and readable storage | |
| Betancourt et al. | The evolution of first person vision methods: A survey | |
| US20190129607A1 (en) | Method and device for performing remote control | |
| JP6502370B2 (en) | Eye tracking based on adaptive homography mapping | |
| WO2020228643A1 (en) | Interactive control method and apparatus, electronic device and storage medium | |
| EP3769509B1 (en) | Multi-endpoint mixed-reality meetings | |
| CN107491174A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| CN112001248B (en) | Active interaction method, device, electronic equipment and readable storage medium | |
| WO2014149381A1 (en) | Personal information communicator | |
| CN202159302U (en) | Augment reality system with user interaction and input functions | |
| Song et al. | Joint estimation of 3D hand position and gestures from monocular video for mobile interaction | |
| WO2023168957A1 (en) | Pose determination method and apparatus, electronic device, storage medium, and program | |
| CN112486394A (en) | Information processing method and device, electronic equipment and readable storage medium | |
| Merino‐Gracia et al. | Real‐time text tracking in natural scenes | |
| CN112818733B (en) | Information processing method, device, storage medium and terminal | |
| CN104134070A (en) | Interactive object tracking system and interactive object tracking method thereof | |
| CN105278658A (en) | Display enhancing method based on temperature-sensitive | |
| CN112241704A (en) | Method and device for judging portrait infringement, electronic equipment and storage medium | |
| CN112488126A (en) | Feature map processing method, device, equipment and storage medium | |
| CN115061577B (en) | Hand projection interaction method, system and storage medium | |
| CN105204608A (en) | Interactive device based on thermosensitive augmented reality | |
| CN105320249A (en) | Interactive method for reality enhancement | |
| Narducci et al. | Enabling consistent hand-based interaction in mixed reality by occlusions handling | |
| CN115223248A (en) | Hand gesture recognition method, and training method and device of hand gesture recognition model | |
| CN105302282A (en) | Thermo-sensitivity based reality augmentation system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160203 |
|
| WD01 | Invention patent application deemed withdrawn after publication |