CN113253830A - Mixed type augmented reality man-machine interaction system - Google Patents
Mixed type augmented reality man-machine interaction system Download PDFInfo
- Publication number
- CN113253830A CN113253830A CN202010087717.XA CN202010087717A CN113253830A CN 113253830 A CN113253830 A CN 113253830A CN 202010087717 A CN202010087717 A CN 202010087717A CN 113253830 A CN113253830 A CN 113253830A
- Authority
- CN
- China
- Prior art keywords
- touch
- equipment
- augmented reality
- reality
- control
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 30
- 230000003993 interaction Effects 0.000 title claims abstract description 16
- 230000003416 augmentation Effects 0.000 claims abstract description 31
- 230000036413 temperature sense Effects 0.000 claims description 9
- 239000004984 smart glass Substances 0.000 claims description 6
- 238000010438 heat treatment Methods 0.000 claims description 5
- 238000005057 refrigeration Methods 0.000 claims description 5
- 239000004065 semiconductor Substances 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 3
- 238000004519 manufacturing process Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Abstract
The invention discloses a mixed augmented reality human-computer interaction system, which comprises an AR reality augmentation system, a human-computer interaction system and a touch alarm system; the AR reality augmentation system comprises an AR reality augmentation device, wherein the AR reality augmentation device comprises an AR view finding device, a logic processing device for running augmented reality software and a display device for displaying virtual models superposed in a real scene.
Description
Technical Field
The invention relates to the field of industry, in particular to a hybrid augmented reality human-computer interaction system.
Background
The augmented reality is that virtual information such as characters, images, three-dimensional models and the like generated by a computer is applied to the real world after being simulated, and the two kinds of information are mutually supplemented, so that the real world is enhanced.
The AR equipment applied to the industrial field at present usually lacks good human-computer interaction, utilize AR human-computer interaction can realize the operation of equipment in a distance, to the production environment that possesses the high risk factor, utilize this kind of mode can effectual realization personnel's protection, can also provide better real operational environment for operating personnel simultaneously, but present AR interactive system is more weak to operating personnel's reverse control, personnel control the condition that often has the distortion based on AR virtual model, take place when leading to whole misoperation.
Disclosure of Invention
The present invention aims to overcome the above-mentioned shortcomings and provide a technical solution to solve the above-mentioned problems.
A hybrid augmented reality human-computer interaction system comprises an AR reality augmentation system, a human-computer interaction system and a touch alarm system;
the AR reality augmentation system comprises an AR reality augmentation device, wherein the AR reality augmentation device consists of an AR view finding device, a logic processing device running augmented reality software and a display device used for displaying that a virtual model is superposed in a real scene;
the AR reality augmentation device identifies and pairs corresponding paired equipment through a specific identification code, the logic processing device loads and runs a virtual model matched with the paired equipment through the identification code, and connection between the AR reality augmentation device and the corresponding paired equipment and loading of the virtual model are achieved based on the virtual model;
the pairing equipment is in communication connection with the AR reality augmentation device through an AR local area network, and data intercommunication among the equipment is realized based on transmission of the wireless network, so that indirect control is realized;
the pairing equipment is connected with pairing equipment input equipment, wherein the pairing equipment input equipment comprises a control panel, a keyboard, a mouse and a touch device of the pairing equipment, and the pairing equipment input equipment can be used for directly controlling and setting the pairing equipment;
the AR reality augmentation device is connected with augmented reality input equipment, the constructed virtual model is adjusted by the augmented reality input equipment, and meanwhile, the control system of the matched equipment is linked by the local area network in the AR through the adjustment of the model, so that AR control is realized;
the augmented reality input equipment comprises a touch screen, a gesture operating system and a voice instruction system, and instructions are transmitted to the AR reality augmentation device in the forms of screen control, gesture control and voice control by utilizing the touch screen, the gesture operating system and the voice instruction system respectively, wherein the gesture control is matched with the AR viewing device, the gestures of operators are simultaneously acquired by the AR viewing device, and the operation control is realized by matching with a virtual model;
a gesture operation system in the augmented reality input equipment is matched with a high-low temperature alarm touch system which is connected with the gesture operation system; the gesture operation system comprises an intelligent bracelet with an identification structure, and positioning and control are realized by wearing the intelligent bracelet with the identification structure, combining an AR viewing device and matching a virtual model; high low temperature alarm sense of touch system sets up in this intelligent bracelet that has the sign structure, high low temperature alarm sense of touch system is including the semiconductor refrigeration piece that is used for making the low temperature sense of touch and the heating wire that is used for making the high temperature sense of touch, high risk touch position and the low risk touch position of this model are instructed to the form cooperation virtual model based on high low temperature sense of touch warning, wholly realize the position of intelligent bracelet in the model according to the location of AR viewing device and intelligent bracelet, high low risk touch region based on the model realizes intelligent instruction, thereby supplementary gesture operating system realizes the operation of low risk.
As a further scheme of the invention: the AR viewing device comprises a smart phone, a tablet personal computer, smart glasses and a network camera.
As a further scheme of the invention: the logic processing device for operating the augmented reality software comprises a smart phone, a tablet personal computer, smart glasses and a desktop host.
As a further scheme of the invention: the display device for displaying the virtual model superposed in the real scene comprises a smart phone, a tablet personal computer and a touch display.
The invention has the beneficial effects that: the intelligent bracelet with the identification structure is additionally provided with a high-low temperature alarm touch system based on the existing AR system, the high-low temperature alarm touch system is arranged in the intelligent bracelet with the identification structure and comprises a semiconductor refrigeration sheet for manufacturing low-temperature touch and a heating wire for manufacturing high-temperature touch, the high-low temperature alarm touch system is matched with a virtual model to indicate a high-risk touch position and a low-risk touch position of the model based on the form of high-low temperature touch warning, the position of the intelligent bracelet in the model is integrally realized according to the positioning of an AR viewing device and the intelligent bracelet, and intelligent indication is realized based on a high-low risk touch area of the model, so that the gesture operation system is assisted to realize the operation of low risk.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
FIG. 1 is a block diagram of the present invention;
fig. 2 is a block diagram of a portion of the architecture of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1-2, in an embodiment of the present invention, a hybrid augmented reality human-computer interaction system includes an AR reality augmentation system, a human-computer interaction system, and a tactile alarm system;
the AR reality augmentation system comprises an AR reality augmentation device, wherein the AR reality augmentation device consists of an AR view finding device, a logic processing device running augmented reality software and a display device used for displaying that a virtual model is superposed in a real scene;
the AR reality augmentation device identifies and pairs corresponding paired equipment through a specific identification code, the logic processing device loads and runs a virtual model matched with the paired equipment through the identification code, and connection between the AR reality augmentation device and the corresponding paired equipment and loading of the virtual model are achieved based on the virtual model;
the pairing equipment is in communication connection with the AR reality augmentation device through an AR local area network, and data intercommunication among the equipment is realized based on transmission of the wireless network, so that indirect control is realized;
the pairing equipment is connected with pairing equipment input equipment, wherein the pairing equipment input equipment comprises a control panel, a keyboard, a mouse and a touch device of the pairing equipment, and the pairing equipment input equipment can be used for directly controlling and setting the pairing equipment;
the AR reality augmentation device is connected with augmented reality input equipment, the constructed virtual model is adjusted by the augmented reality input equipment, and meanwhile, the control system of the matched equipment is linked by the local area network in the AR through the adjustment of the model, so that AR control is realized;
the augmented reality input equipment comprises a touch screen, a gesture operating system and a voice instruction system, and instructions are transmitted to the AR reality augmentation device in the forms of screen control, gesture control and voice control by utilizing the touch screen, the gesture operating system and the voice instruction system respectively, wherein the gesture control is matched with the AR viewing device, the gestures of operators are simultaneously acquired by the AR viewing device, and the operation control is realized by matching with a virtual model;
a gesture operation system in the augmented reality input equipment is matched with a high-low temperature alarm touch system which is connected with the gesture operation system; the gesture operation system comprises an intelligent bracelet with an identification structure, and positioning and control are realized by wearing the intelligent bracelet with the identification structure, combining an AR viewing device and matching a virtual model; high low temperature alarm sense of touch system sets up in this intelligent bracelet that has the sign structure, high low temperature alarm sense of touch system is including the semiconductor refrigeration piece that is used for making the low temperature sense of touch and the heating wire that is used for making the high temperature sense of touch, high risk touch position and the low risk touch position of this model are instructed to the form cooperation virtual model based on high low temperature sense of touch warning, wholly realize the position of intelligent bracelet in the model according to the location of AR viewing device and intelligent bracelet, high low risk touch region based on the model realizes intelligent instruction, thereby supplementary gesture operating system realizes the operation of low risk.
The AR viewing device comprises a smart phone, a tablet personal computer, smart glasses and a network camera.
The logic processing device for operating the augmented reality software comprises a smart phone, a tablet personal computer, smart glasses and a desktop host.
The display device for displaying the virtual model superposed in the real scene comprises a smart phone, a tablet personal computer and a touch display.
The working principle of the invention is as follows: the intelligent bracelet with the identification structure is additionally provided with a high-low temperature alarm touch system based on the existing AR system, the high-low temperature alarm touch system is arranged in the intelligent bracelet with the identification structure and comprises a semiconductor refrigeration sheet for manufacturing low-temperature touch and a heating wire for manufacturing high-temperature touch, the high-low temperature alarm touch system is matched with a virtual model to indicate a high-risk touch position and a low-risk touch position of the model based on the form of high-low temperature touch warning, the position of the intelligent bracelet in the model is integrally realized according to the positioning of an AR viewing device and the intelligent bracelet, and intelligent indication is realized based on a high-low risk touch area of the model, so that the gesture operation system is assisted to realize the operation of low risk.
It will be evident to those skilled in the art that the invention is not limited to the details of the foregoing illustrative embodiments, and that the present invention may be embodied in other specific forms without departing from the spirit or essential attributes thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description, and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.
Claims (4)
1. A hybrid augmented reality human-computer interaction system is characterized by comprising an AR reality augmentation system, a human-computer interaction system and a touch alarm system;
the AR reality augmentation system comprises an AR reality augmentation device, wherein the AR reality augmentation device consists of an AR view finding device, a logic processing device running augmented reality software and a display device used for displaying that a virtual model is superposed in a real scene;
the AR reality augmentation device identifies and pairs corresponding paired equipment through a specific identification code, the logic processing device loads and runs a virtual model matched with the paired equipment through the identification code, and connection between the AR reality augmentation device and the corresponding paired equipment and loading of the virtual model are achieved based on the virtual model;
the pairing equipment is in communication connection with the AR reality augmentation device through an AR local area network, and data intercommunication among the equipment is realized based on transmission of the wireless network, so that indirect control is realized;
the pairing equipment is connected with pairing equipment input equipment, wherein the pairing equipment input equipment comprises a control panel, a keyboard, a mouse and a touch device of the pairing equipment, and the pairing equipment input equipment can be used for directly controlling and setting the pairing equipment;
the AR reality augmentation device is connected with augmented reality input equipment, the constructed virtual model is adjusted by the augmented reality input equipment, and meanwhile, the control system of the matched equipment is linked by the local area network in the AR through the adjustment of the model, so that AR control is realized;
the augmented reality input equipment comprises a touch screen, a gesture operating system and a voice instruction system, and instructions are transmitted to the AR reality augmentation device in the forms of screen control, gesture control and voice control by utilizing the touch screen, the gesture operating system and the voice instruction system respectively, wherein the gesture control is matched with the AR viewing device, the gestures of operators are simultaneously acquired by the AR viewing device, and the operation control is realized by matching with a virtual model;
a gesture operation system in the augmented reality input equipment is matched with a high-low temperature alarm touch system which is connected with the gesture operation system; the gesture operation system comprises an intelligent bracelet with an identification structure, and positioning and control are realized by wearing the intelligent bracelet with the identification structure, combining an AR viewing device and matching a virtual model; high low temperature alarm sense of touch system sets up in this intelligent bracelet that has the sign structure, high low temperature alarm sense of touch system is including the semiconductor refrigeration piece that is used for making the low temperature sense of touch and the heating wire that is used for making the high temperature sense of touch, high risk touch position and the low risk touch position of this model are instructed to the form cooperation virtual model based on high low temperature sense of touch warning, wholly realize the position of intelligent bracelet in the model according to the location of AR viewing device and intelligent bracelet, high low risk touch region based on the model realizes intelligent instruction, thereby supplementary gesture operating system realizes the operation of low risk.
2. The hybrid augmented reality human-computer interaction system of claim 1, wherein the AR viewing device comprises a smartphone, a tablet, smart glasses, a webcam.
3. The hybrid augmented reality human-computer interaction system of claim 1, wherein the logic processing device running the augmented reality software comprises a smart phone, a tablet computer, smart glasses, and a desktop host.
4. The hybrid augmented reality human-computer interaction system of claim 1, wherein the display device displaying the virtual model overlaid in the real scene comprises a smartphone, a tablet computer, and a touch display.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010087717.XA CN113253830A (en) | 2020-02-11 | 2020-02-11 | Mixed type augmented reality man-machine interaction system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010087717.XA CN113253830A (en) | 2020-02-11 | 2020-02-11 | Mixed type augmented reality man-machine interaction system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113253830A true CN113253830A (en) | 2021-08-13 |
Family
ID=77219615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010087717.XA Pending CN113253830A (en) | 2020-02-11 | 2020-02-11 | Mixed type augmented reality man-machine interaction system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113253830A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103458355A (en) * | 2012-05-28 | 2013-12-18 | 富泰华工业（深圳）有限公司 | Electronic glove |
| CN106340217A (en) * | 2016-10-31 | 2017-01-18 | 华中科技大学 | Augmented reality technology based manufacturing equipment intelligent system and its implementation method |
| US20170301137A1 (en) * | 2016-04-15 | 2017-10-19 | Superd Co., Ltd. | Method, apparatus, and smart wearable device for fusing augmented reality and virtual reality |
| CN108919942A (en) * | 2018-05-25 | 2018-11-30 | 江西博异自动化科技有限公司 | Mixed type augmented reality man-machine interactive system |
| CN109388226A (en) * | 2017-08-04 | 2019-02-26 | 北京臻迪科技股份有限公司 | A kind of intelligent wearable device |
-
2020
- 2020-02-11 CN CN202010087717.XA patent/CN113253830A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103458355A (en) * | 2012-05-28 | 2013-12-18 | 富泰华工业（深圳）有限公司 | Electronic glove |
| US20170301137A1 (en) * | 2016-04-15 | 2017-10-19 | Superd Co., Ltd. | Method, apparatus, and smart wearable device for fusing augmented reality and virtual reality |
| CN106340217A (en) * | 2016-10-31 | 2017-01-18 | 华中科技大学 | Augmented reality technology based manufacturing equipment intelligent system and its implementation method |
| CN109388226A (en) * | 2017-08-04 | 2019-02-26 | 北京臻迪科技股份有限公司 | A kind of intelligent wearable device |
| CN108919942A (en) * | 2018-05-25 | 2018-11-30 | 江西博异自动化科技有限公司 | Mixed type augmented reality man-machine interactive system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8046719B2 (en) | Virtual work place | |
| CN107491174A (en) | Method, apparatus, system and electronic equipment for remote assistance | |
| CN202838267U (en) | Projection touch system | |
| CN103731645A (en) | Law enforcement and case handling system based on wireless video transmission technology | |
| CN102981719A (en) | Method and system for parameter configuration | |
| CN107452119A (en) | virtual reality real-time navigation method and system | |
| EP4057137A1 (en) | Display control method and terminal device | |
| JP2022126793A (en) | Method and device for controlling terminal, electronic apparatus, storage medium, and computer program | |
| CN102830925A (en) | Operation control method of display terminal to mobile terminal as well as display terminal thereof | |
| US20120274589A1 (en) | Apparatus, system, and method for remote interaction with a computer display or computer visualization or object | |
| CN105183236A (en) | Touch screen input device and method | |
| CN111156855A (en) | Electronic warfare equipment virtual training man-machine interaction system | |
| TWI738149B (en) | Smart inspection method and smart inspection system | |
| CN104143066A (en) | Security information exchanging device | |
| CN104731338A (en) | Closed type augmented and virtual reality system and method | |
| CN105578313B (en) | Long-range control method, system are remote to control execution method, system and mobile terminal | |
| TWI771710B (en) | Intellectual host switching system and method | |
| US10591986B2 (en) | Remote work supporting system, remote work supporting method, and program | |
| CN113253830A (en) | Mixed type augmented reality man-machine interaction system | |
| CN112929734A (en) | Screen projection method and device and electronic equipment | |
| CN112184881A (en) | Multi-level overall process monitoring method for power equipment | |
| CN104199629B (en) | Multiple solutions linked system and its method that multiple solutions linkage is realized by network connection | |
| CN108919942A (en) | Mixed type augmented reality man-machine interactive system | |
| CN105786672A (en) | Monitoring system for virtual reality environment and monitoring method thereof | |
| CN102722250A (en) | Method and system for interactive editing of image control points |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210813 |